-- Logs begin at Tue 2022-04-05 10:16:46 UTC, end at Tue 2022-04-05 11:37:18 UTC. -- Apr 05 11:03:52.904694 dv-cinder-818994-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 05 11:03:52.913540 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 5 11:03:52 2022] *** Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: nodename: dv-cinder-818994-3-iscsi Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: machine: x86_64 Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: clock source: unix Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: pcre jit disabled Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: detected number of CPU cores: 4 Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: current working directory: / Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: detected binary path: /usr/bin/uwsgi-core Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: your processes number limit is 47680 Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: your memory page size is 4096 bytes Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: detected max file descriptor number: 2048 Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: lock engine: pthread robust mutexes Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: thunder lock: enabled Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 05 11:03:52.918636 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 05 11:03:52.962296 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: Python main interpreter initialized at 0x55d3c00739c0 Apr 05 11:03:52.962296 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: python threads support enabled Apr 05 11:03:52.962296 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: your server socket listen backlog is limited to 100 connections Apr 05 11:03:52.962296 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: your mercy for graceful operations on workers is 90 seconds Apr 05 11:03:52.963061 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: mapped 403077 bytes (393 KB) for 2 cores Apr 05 11:03:52.963061 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: *** Operational MODE: preforking *** Apr 05 11:03:52.963061 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: *** uWSGI is running in multiple interpreter mode *** Apr 05 11:03:52.963061 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: spawned uWSGI master process (pid: 103220) Apr 05 11:03:52.963206 dv-cinder-818994-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 05 11:03:52.964935 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: spawned uWSGI worker 1 (pid: 103221, cores: 1) Apr 05 11:03:52.964935 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: spawned uWSGI worker 2 (pid: 103222, cores: 1) Apr 05 11:03:52.964935 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 05 11:03:54.174835 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 11:03:54.175618 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 11:03:55.027932 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:03:55.027932 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: from cryptography.utils import int_from_bytes Apr 05 11:03:55.028255 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:03:55.028255 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: from cryptography.utils import int_from_bytes Apr 05 11:03:55.028403 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:03:55.028403 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: from cryptography.utils import int_from_bytes Apr 05 11:03:55.028658 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:03:55.028658 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: from cryptography.utils import int_from_bytes Apr 05 11:03:57.564501 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:03:57.565031 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 11:03:57.565180 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:03:57.565281 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:03:57.565626 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 11:03:57.565706 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 11:03:57.565796 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 11:03:57.565951 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:03:57.566144 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.566314 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 11:03:57.566466 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.566552 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 11:03:57.566809 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.566968 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.567126 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.567293 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.567452 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.567616 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.567759 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.567936 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.568077 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.568267 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.568394 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.568578 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.568719 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.568900 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.568989 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.569223 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.569319 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.569550 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.569647 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818994-3-iscsi {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.569810 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.569904 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.570127 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.570220 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.570453 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818994-3-iscsi {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.570540 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.570799 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.570885 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.571101 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.571211 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.571421 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.571514 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.571722 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.571816 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.572065 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.572217 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.572387 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.573377 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.573479 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.573562 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.573628 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.573705 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.573798 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.573866 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.573930 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.574001 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.574076 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.574141 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.574396 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.574507 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.574731 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.574929 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.575116 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.575302 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.575471 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.575678 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.575902 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.576091 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818994-3-iscsi {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.576281 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.576458 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.576735 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.576926 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.577102 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818994-3-iscsi {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.577277 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.577464 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.577677 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.577905 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.578086 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.578265 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.578404 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.578553 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.578712 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.578868 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.578992 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.579130 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.579268 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.579398 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.579530 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.579686 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.579823 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.579948 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.580071 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.580193 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.580314 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.580436 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.580569 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.580569 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.580813 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.580962 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.581086 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.581208 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.581342 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.581465 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.581588 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.581710 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.581838 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.581970 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.582093 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.582215 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.582336 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.582458 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.582580 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.582773 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.582900 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.583078 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.583202 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.583327 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.583448 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.583640 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.583769 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.583892 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.584020 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.584168 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.584303 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.584473 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.584605 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.584779 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.584904 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.585084 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.585219 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.585388 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.585513 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.585691 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.585823 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.585994 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.586126 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.586296 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.586426 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.586598 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.587017 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.587017 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.587231 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.587344 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.587452 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.587565 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.587693 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.587827 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.587951 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.588113 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.588239 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.588433 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.588568 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.588743 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.588877 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.589046 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.589168 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.589382 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.589521 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.589685 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.589810 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.589993 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.590126 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.590308 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.590444 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.590644 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.590774 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.590954 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.591082 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.591257 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.591396 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.591563 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.591687 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.591873 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.591998 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.592181 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.592315 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.592482 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.592613 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.592743 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.592872 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.593003 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.593127 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.593305 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.593914 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.594134 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.594269 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.594440 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.594565 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.594754 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.594876 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.595057 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.595192 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.595355 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.595481 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.595660 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.595784 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.595962 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.596092 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.596261 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.596392 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.596563 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.596687 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.596867 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.597000 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.597167 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.597292 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.597470 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.597595 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.597771 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.597905 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.598072 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.598196 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.598381 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.598507 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.598709 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.598849 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.599012 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.599143 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.599314 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.599442 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.599615 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.599749 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.599921 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.600046 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.600223 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.600347 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.600529 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.600663 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.600865 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.600989 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.601117 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.601240 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.601424 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.601560 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.601727 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.601858 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.602042 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.602167 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.602345 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.602482 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.602670 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.602799 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.602986 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.603110 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.603286 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.603420 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.603588 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.603713 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.603900 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.604024 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.604199 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.604323 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.604499 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.604631 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.604798 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.604925 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.605097 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.605223 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.605397 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.605522 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.605698 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.605822 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.605993 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.606118 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.606293 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.606417 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.606588 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.606788 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.606922 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.607050 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.607180 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.607303 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.607486 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.607624 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.607803 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.607928 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.608102 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.608226 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.608416 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.608549 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.608723 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.608851 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.609071 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.609205 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.609396 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:03:57.609531 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.609732 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.609885 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.610063 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.610774 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.610932 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.611069 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.611250 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.611375 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.611560 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.611693 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.611872 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.612000 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.612197 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.612329 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.612506 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.612637 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.612813 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.612938 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.613122 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.613246 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.613435 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.613559 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.613746 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.613874 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.614059 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.614193 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.614370 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.614580 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.614742 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.614867 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.614997 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.615121 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.615301 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.615434 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.615614 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.615740 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.615929 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.616061 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.616241 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.616367 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.616547 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.616672 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.616870 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.616995 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.617193 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.617332 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.617507 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.617640 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.617825 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.617949 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.618142 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.618276 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.618448 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.618582 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.618781 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.618908 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.619088 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.619234 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.619403 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.619528 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.619708 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.619833 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.620020 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.620155 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.620336 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.620461 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.620644 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.620770 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.620953 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.621080 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.621258 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.621384 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.621563 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.621695 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.621870 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.622003 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.622175 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.622299 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.622485 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.622639 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.622820 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.622948 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.623127 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.623257 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.623441 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.623568 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.623763 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.623888 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.624041 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.624173 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.624347 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.624481 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.624681 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.624807 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.624986 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.625119 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.625288 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.625423 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.625594 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.625720 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.625893 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.626024 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.626197 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.626333 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.626506 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.626686 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.626822 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.626953 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.627141 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.627275 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.627442 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.627567 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.627750 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.627882 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.628056 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.628194 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.628364 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.628488 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.628668 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.628792 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.628976 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.629099 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.629279 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.629401 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.629582 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.629706 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.629891 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.630014 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.630200 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.630322 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.630503 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.630648 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.630848 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.630979 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.631153 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.631277 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.631457 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.631580 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.631771 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.631905 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.632075 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.632198 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.632431 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.632569 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.632693 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.632819 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.632985 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.633112 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.633296 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.633429 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.633603 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.633733 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.633914 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.634041 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.634241 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.634375 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.634556 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.634801 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.634925 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.635048 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.635183 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.635316 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.635499 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.635633 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.635813 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.635939 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.636116 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.636243 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.636422 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.636548 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.636722 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.636848 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.637024 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.637160 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.637327 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.637461 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.637633 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.637766 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.637933 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.638059 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.638235 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.638359 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.638533 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.638686 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.638864 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.638989 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.639165 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.639299 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.639466 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.639603 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.639770 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.639904 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.640074 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.640207 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.640400 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.640535 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.640701 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.640834 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.641002 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.641126 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.641310 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.641450 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.641614 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.641749 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.641958 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.642085 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.642265 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.642393 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.642583 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.642738 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.642915 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.643041 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.643227 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.643354 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.643535 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.643660 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.643843 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.643969 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.644402 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.644531 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.644709 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.644835 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.645017 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.645141 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.645323 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.645447 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.645632 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.645758 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.645936 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.646060 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.646250 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.646375 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.646552 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.646700 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.646891 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.647028 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.647192 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.647323 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.647503 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.647655 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.647820 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.647957 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.648128 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.648255 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.648443 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.648568 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.648767 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.648899 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.649077 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.649205 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.649374 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.649498 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.649681 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.649821 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.649994 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.650128 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.650301 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.650441 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.650647 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.650780 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.650938 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.651061 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.651230 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.651356 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.651540 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.651674 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.651844 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.651970 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.652153 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.652277 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.652475 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.652598 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.652753 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.652877 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.653046 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.653180 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.653355 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.653480 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.653668 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.653797 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.653974 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.654098 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.654286 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.654412 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.654592 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.654737 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.654932 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.655074 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.655239 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.655372 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.655546 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.655681 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.656348 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.656489 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.656659 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.656785 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.656961 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.657096 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.657266 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.657400 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.657568 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.657692 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.657872 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.657998 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.658176 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.658310 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.658478 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.658652 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.658809 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.658934 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.659115 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.659253 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.659417 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.659550 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.659719 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.659836 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.660027 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.660161 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.660328 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.660453 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.660633 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.660766 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.660946 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.661073 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.661263 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.661388 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.661567 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.661692 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.661867 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.661994 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.662185 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.662312 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.662489 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.662642 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.662815 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.662942 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.663118 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.663245 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.663419 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.663554 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.663722 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.663845 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.664027 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.664160 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.664332 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.664477 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.664642 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.664774 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.664958 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.665084 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.665263 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.665399 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.665572 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.665696 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.665877 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.666003 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.666181 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.666308 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.666493 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.666648 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.666827 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.666953 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.667134 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.667263 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.667443 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.667568 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.667751 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.667884 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.668058 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.668184 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.668516 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.668658 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.668658 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.668880 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.669011 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.669142 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.669264 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.669386 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.669559 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.669694 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.669861 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.669987 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.670167 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.670292 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.670477 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.670649 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.670805 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.671066 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.671203 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.671392 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.671546 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.671780 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.672023 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.672150 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.672354 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.672481 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.672671 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.672807 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.672988 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.673114 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.673306 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.673432 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.673622 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.673749 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.673924 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.674057 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.674230 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.674363 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.674532 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.674688 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.674874 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.675019 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.675180 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.675306 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.675480 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.675606 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.675781 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.675916 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.676081 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.676208 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.676367 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.676488 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.676661 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.676794 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.676963 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.677089 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.677261 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.677387 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.677562 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.677687 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.677866 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.677993 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.678164 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.678289 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.678467 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.678665 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.678792 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.678913 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.679093 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.679221 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.679399 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.679526 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.679698 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.679831 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.679996 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.680123 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.680294 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.680421 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.680597 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.680722 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.680899 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.681038 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.681202 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.681330 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.681542 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.681668 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.681851 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.681986 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.682170 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.682295 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.682472 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.682598 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.682818 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.682954 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.683120 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.683246 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.683421 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.683547 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.683721 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.683848 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.684025 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.684151 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.684325 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.684450 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.684622 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.684747 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.684927 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.685051 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.685229 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.685353 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.685528 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.685659 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.685828 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.685953 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.686126 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.686259 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.686429 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.686555 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.686741 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.686864 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.687049 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.687737 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.687883 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.688006 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.688152 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.688285 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.688453 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.688589 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.688760 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.688886 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.689060 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.689185 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.689359 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.689496 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.689664 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.689789 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.689961 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.690092 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.690260 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.690393 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.690561 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.690706 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.690886 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.691023 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.691185 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.691322 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.691490 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.691623 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.691791 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.691916 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.692089 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.692214 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.692401 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.692526 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.692705 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.692836 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.693004 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.693130 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.693301 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.693426 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.693607 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.693734 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.693910 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.694036 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.694209 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.694334 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.694512 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.694693 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.694821 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.694943 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.695125 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.695278 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.695433 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.695568 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.695738 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.695865 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.696038 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.696164 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.696339 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.696474 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.696641 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.696767 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.696941 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.697065 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.697241 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.697373 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.697540 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.697667 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.697839 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.697967 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.698140 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.698266 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.698436 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.698561 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.698761 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.698896 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.699065 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.699193 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.699368 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.699502 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.699688 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.699815 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.699998 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.700126 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.700303 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.700429 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.700605 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.700731 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.700908 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.701035 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.701249 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.701376 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.701552 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.701691 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.701864 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.701988 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.702175 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.702302 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.702484 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.702650 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.702886 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.703020 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.703189 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.703315 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.703498 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.703631 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.703802 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.703927 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.704105 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.704231 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.704404 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.704537 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.704703 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.704830 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.705011 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.705142 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.705316 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.705453 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.705619 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.705745 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.705934 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.706059 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.706242 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.706369 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.706553 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.706701 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.706879 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.707004 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.707186 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.707314 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.707507 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.707639 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.707810 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.707935 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.708119 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.708253 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.708427 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.708554 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.708732 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.708857 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.709070 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.709186 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.709315 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.709439 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.709626 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.709761 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.709930 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.710062 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.710231 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.710350 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.710536 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.710710 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.710866 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.710991 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.711168 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.711292 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.711471 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.711607 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.711778 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.711920 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.712077 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.712202 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.712381 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.712805 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.712929 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.713061 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.713193 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.713316 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.713447 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.713571 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.713571 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.713847 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.713971 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.714102 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.714242 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.714366 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.714540 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.714707 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.714871 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.714997 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.715178 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.715304 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.715486 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.715626 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.715757 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.715882 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.716067 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.716193 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.716381 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.716508 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.716693 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.716829 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.716995 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.717128 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.717354 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.717487 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.717656 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.717789 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.717957 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.718083 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.718261 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.718940 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.719125 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.719264 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.719426 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.719551 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.719725 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.719850 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.720027 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.720166 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.720332 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.720449 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.720629 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.720753 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.720928 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.721064 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.721247 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.721374 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.721547 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.721673 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.721866 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.721992 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.722283 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.722409 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.722594 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.722749 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.723043 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.723193 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.723330 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.723454 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.723585 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.723709 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.723845 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.723970 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.724137 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.724268 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.724447 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.724581 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.724767 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.724902 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.725058 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.725186 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.725378 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.725512 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.725683 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.725822 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.725991 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.726118 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.726292 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.726419 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.726627 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.726769 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.726941 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.727075 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.727247 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.727375 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.727561 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.727761 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.727888 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.728011 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.728176 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.728311 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.728499 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.728634 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.728873 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.728999 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.729194 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.729322 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.729497 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.729625 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.729796 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.729924 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.730101 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.730228 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.730405 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.730527 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.730731 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.730875 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.731051 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.731178 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.731360 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.731489 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.731666 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.731801 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.731972 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.732099 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.732275 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.732411 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.732578 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.732704 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.732880 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.733014 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.733184 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.733320 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.733484 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.733610 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.733787 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.733947 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.734646 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.734776 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.734958 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.735087 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.735283 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.735492 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.735628 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.735754 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.735908 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.736035 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.736228 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.736361 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.736530 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.736659 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.736830 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.736972 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.737131 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.737259 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.737432 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.737559 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.737738 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.737866 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.738042 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.738177 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.738376 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.738502 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.738700 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.738828 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.739018 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.739152 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.739348 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.739466 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.739669 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.739794 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.739977 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.740111 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.740290 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.740415 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.740610 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.740745 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.740911 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.741038 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.741211 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.741339 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.741522 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.741656 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.741823 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.741950 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.742123 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.742249 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.742420 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.742554 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.742744 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.742871 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.743047 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.743173 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.743346 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.743489 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.743646 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.743780 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.743945 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.744071 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.744248 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.744376 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.744550 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.744684 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.744856 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.744981 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.745156 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.745284 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.745456 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.745583 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.745755 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.745882 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.746057 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.746185 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.746361 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.746488 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.746687 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.746817 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.747018 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.747144 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.747319 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.747444 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.747644 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.747790 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.747950 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.748085 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.748267 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.748393 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.748574 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.748716 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.748884 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.749010 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.749214 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.749349 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.749498 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.749646 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.749830 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.749969 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.750140 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.750274 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.750449 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.750588 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.750778 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.750904 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.751087 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.751213 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.751395 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.751523 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.751703 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.751838 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.752014 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.752222 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.752358 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.752550 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.752678 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.752862 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.753139 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.753267 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.753468 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.753604 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.753774 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.753911 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.754082 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.754214 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.754389 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.754522 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.754705 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.754831 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.755014 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.755157 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.755319 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.755445 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.755627 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.755757 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.755936 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.756071 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.756242 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.756369 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.756568 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.756697 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.756877 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.757004 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.757188 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.757315 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.757498 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.757626 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.757806 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.757941 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.758114 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.758241 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.758426 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.758561 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.758762 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.758890 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.759072 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.759208 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.759384 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.759526 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.759695 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.759841 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.760003 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.760130 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.760310 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.760445 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.760618 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.760750 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.760924 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.761049 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.761230 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.761362 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.761538 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.761671 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.761844 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.761971 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.762151 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.762277 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.762457 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.762584 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.762798 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.762937 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.763112 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.763248 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.763420 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.763545 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.763732 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.763934 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.764063 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.764186 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.764358 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.764542 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.764669 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.764851 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.764979 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.765182 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.765501 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.765636 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.765814 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.765954 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.766130 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.766256 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.766443 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.766570 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.766795 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.766934 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.767094 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.767221 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.767397 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.767524 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.767704 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.767832 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.768010 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.768136 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.768310 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.768437 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.768617 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.768751 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.768921 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.769294 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.769473 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.769604 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.769790 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.769918 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.770095 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.770222 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.770395 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.770641 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.770785 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.770986 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.771114 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.771298 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.771560 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.771695 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.771905 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.772043 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.772222 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.772357 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.772525 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.772664 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.772845 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.772980 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.773148 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.773274 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.773449 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.773589 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.773760 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.773887 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.774065 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.774190 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.774363 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.774490 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.774686 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.774824 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.774995 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.775115 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.775297 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.775423 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.775594 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.775719 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.775897 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.776032 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.776196 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.776324 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.776498 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.776632 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.776805 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.776930 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.777105 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.777231 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.777405 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.777531 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.777713 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.777852 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.778014 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.778139 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.778314 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.778441 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.778645 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.778788 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.778936 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.779070 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.779241 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.779367 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.779541 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.779677 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.779841 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.779967 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.780138 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.780272 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.780442 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.780575 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.780739 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.781367 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.781551 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.781677 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.781861 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.782000 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.782165 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.782298 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.782472 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.782599 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.782805 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.782933 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.783118 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.783245 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.783423 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.783558 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.783740 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.783876 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.784048 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.784176 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.784354 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.784480 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.784676 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.784805 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.784987 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.785122 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.785298 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.785509 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.785649 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.785840 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.785960 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.786156 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.786462 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.786654 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.786821 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.786950 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.787124 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.787253 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.787426 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.787562 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.787731 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.787859 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.788052 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.788187 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.788357 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.788495 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.788661 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.788787 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.788967 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.789095 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.789273 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.789401 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.789579 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.789706 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.789883 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.790001 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.790189 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.790316 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.790492 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.790646 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.790822 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.790949 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.791127 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.791256 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.791433 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.791559 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.791736 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.791874 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.792041 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.792167 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.792349 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.792477 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.792658 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.792794 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.792970 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.793097 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.793278 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.793404 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.793589 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.793786 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.793913 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.794037 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.794188 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.794315 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.794493 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.794660 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.794823 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.794951 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.795132 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.795259 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.795439 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.795574 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.795748 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.795876 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.796048 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.796174 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.796375 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.796543 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.796741 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.796876 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.797047 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.797175 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.797433 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.797561 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.797738 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.797867 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.798058 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.798194 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.798375 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.798512 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.798702 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.798830 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.799022 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.799162 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.799330 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.799459 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.799639 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.799766 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.799960 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.800089 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.800270 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.800407 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.800596 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.800723 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.800900 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.801028 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.801202 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.801337 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.801504 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.801643 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.801810 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.801938 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.802128 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.802255 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.802430 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.802556 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.802755 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.802892 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.803057 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.803192 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.803362 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.803498 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.803662 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.803789 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.803962 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.804088 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.804258 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.804392 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.804559 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.804685 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.804863 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.804998 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.805160 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.805299 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.805462 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.805588 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.805758 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.805884 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.806057 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.806192 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.806356 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.806484 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.806677 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.806806 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.806983 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.807112 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.807282 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.807418 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.807583 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.807709 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.807879 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.808018 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.808178 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.808306 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.808477 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.808611 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.808779 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.808906 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.809082 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.809211 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.809385 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.809512 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.809714 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.809850 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.810020 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.810147 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.810337 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.810472 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.810655 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.810793 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.810972 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.811104 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.811290 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.811425 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.811599 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.811725 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.811911 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.812039 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.812753 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.812888 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.813058 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.813184 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.813366 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.813492 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.813671 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.813844 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.813981 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.814113 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.814267 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.814405 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.814636 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.814772 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.814897 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.815020 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.815204 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.815342 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.815513 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.815647 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.815834 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.815970 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.816147 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.816275 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.816504 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.816638 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.816763 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.816885 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.817055 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.817198 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.817380 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.817506 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.817687 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.817811 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.817993 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.818129 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.818304 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.818440 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.818651 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.818781 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.818939 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.819078 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.819251 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.819383 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.819558 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.819684 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.819865 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.819991 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.820181 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.820300 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.820496 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.820626 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.820816 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.820947 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.821138 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.821269 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.821454 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.821587 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.821777 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.821910 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.822110 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.822234 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.822422 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.822547 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.822772 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.822901 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.823025 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.823148 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.823278 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 11:03:57.823412 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.823707 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.824013 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:03:57.824256 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 11:03:57.846473 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG oslo_db.sqlalchemy.engines [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:03:57.847667 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_db.sqlalchemy.engines [None req-fc8ad3e2-9fd1-4f1e-b8d5-904b90cb68a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:03:57.909226 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.context [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc(cell1) {{(pid=103221) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 11:03:57.910158 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.context [None req-fc8ad3e2-9fd1-4f1e-b8d5-904b90cb68a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc(cell1) {{(pid=103222) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 11:03:57.913535 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:03:57.914440 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-fc8ad3e2-9fd1-4f1e-b8d5-904b90cb68a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:03:57.915155 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:03:57.915948 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:03:57.916049 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-fc8ad3e2-9fd1-4f1e-b8d5-904b90cb68a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:03:57.916853 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-fc8ad3e2-9fd1-4f1e-b8d5-904b90cb68a6 None None] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:03:57.917887 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG oslo_concurrency.lockutils [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:03:57.918840 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-fc8ad3e2-9fd1-4f1e-b8d5-904b90cb68a6 None None] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:03:57.932650 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG oslo_db.sqlalchemy.engines [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:03:57.932980 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG oslo_db.sqlalchemy.engines [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:03:57.933743 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_db.sqlalchemy.engines [None req-fc8ad3e2-9fd1-4f1e-b8d5-904b90cb68a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:03:57.935928 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_db.sqlalchemy.engines [None req-fc8ad3e2-9fd1-4f1e-b8d5-904b90cb68a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:03:58.089471 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG oslo_db.sqlalchemy.engines [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:03:58.092262 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_db.sqlalchemy.engines [None req-fc8ad3e2-9fd1-4f1e-b8d5-904b90cb68a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:03:58.639375 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: WARNING keystonemiddleware.auth_token [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:03:58.646865 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: WARNING keystonemiddleware.auth_token [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:03:58.651204 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: WARNING keystonemiddleware.auth_token [None req-fc8ad3e2-9fd1-4f1e-b8d5-904b90cb68a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:03:58.657987 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: WARNING keystonemiddleware.auth_token [None req-fc8ad3e2-9fd1-4f1e-b8d5-904b90cb68a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:03:58.874360 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: WARNING keystonemiddleware.auth_token [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:03:58.879549 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: WARNING keystonemiddleware.auth_token [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:03:58.881877 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: WARNING keystonemiddleware.auth_token [None req-fc8ad3e2-9fd1-4f1e-b8d5-904b90cb68a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:03:58.884888 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d3c00739c0 pid: 103221 (default app) Apr 05 11:03:58.886946 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:03:58.887040 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: WARNING keystonemiddleware.auth_token [None req-fc8ad3e2-9fd1-4f1e-b8d5-904b90cb68a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:03:58.888119 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Apr 05 11:03:58.888548 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Tue Apr 5 11:03:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:03:58.892933 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d3c00739c0 pid: 103222 (default app) Apr 05 11:05:21.412316 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:21.413314 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Apr 05 11:05:21.413712 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:05:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:05:21.874211 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-02f54309-74c2-4b0f-872e-620a74596367 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:21.904762 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-02f54309-74c2-4b0f-872e-620a74596367 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.482297 Apr 05 11:05:21.908844 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1291 bytes} [Tue Apr 5 11:05:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:05:24.268089 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:24.269080 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-2710fe73-3ed3-4985-8bf4-9eb938d3b184 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Apr 05 11:05:24.269755 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 3/4] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:05:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:05:24.335449 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-669015ec-b6cd-4712-b475-cb63789b33fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1"}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:24.353655 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:05:24.353655 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: warnings.warn(msg) Apr 05 11:05:24.449157 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-669015ec-b6cd-4712-b475-cb63789b33fd admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.173565 Apr 05 11:05:24.449791 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 2/5] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Apr 5 11:05:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:05:24.668001 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-578d51e2-f9c9-4185-93d7-99088f19ac49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:24.671190 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:05:24.671190 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: warnings.warn(msg) Apr 05 11:05:24.789120 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-578d51e2-f9c9-4185-93d7-99088f19ac49 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.331033 Apr 05 11:05:24.789713 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 4/6] 10.222.0.39 () {64 vars in 1335 bytes} [Tue Apr 5 11:05:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:05:27.161374 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-669015ec-b6cd-4712-b475-cb63789b33fd admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:27.162838 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-669015ec-b6cd-4712-b475-cb63789b33fd admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Apr 05 11:05:27.163203 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 3/7] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:05:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:05:27.304613 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-64a6e963-2323-4b2f-850f-ac4f397db6a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "swap": 0, "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1"}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:27.325356 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:05:27.325356 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: warnings.warn(msg) Apr 05 11:05:27.429283 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-64a6e963-2323-4b2f-850f-ac4f397db6a5 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.260263 Apr 05 11:05:27.429951 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 5/8] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Apr 5 11:05:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:05:27.442597 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-ea9329c7-97e9-4942-8d01-a44a0b776551 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:27.444453 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:05:27.444453 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: warnings.warn(msg) Apr 05 11:05:27.552154 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-ea9329c7-97e9-4942-8d01-a44a0b776551 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113778 Apr 05 11:05:27.552854 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 4/9] 10.222.0.39 () {64 vars in 1335 bytes} [Tue Apr 5 11:05:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:05:29.891045 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-64a6e963-2323-4b2f-850f-ac4f397db6a5 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:29.892858 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-64a6e963-2323-4b2f-850f-ac4f397db6a5 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002363 Apr 05 11:05:29.893540 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:05:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:05:29.954535 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-bbc9aea5-3901-4f36-acf9-ebff5fb155ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:30.071839 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-bbc9aea5-3901-4f36-acf9-ebff5fb155ad admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.172056 Apr 05 11:05:30.072789 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 5/11] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Apr 5 11:05:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:05:30.086251 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-060e288d-d80f-4a32-9302-e094333935b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:30.180560 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-060e288d-d80f-4a32-9302-e094333935b3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098199 Apr 05 11:05:30.202635 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 7/12] 10.222.0.39 () {64 vars in 1335 bytes} [Tue Apr 5 11:05:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:05:32.528652 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-bbc9aea5-3901-4f36-acf9-ebff5fb155ad admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:32.529653 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-bbc9aea5-3901-4f36-acf9-ebff5fb155ad admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Apr 05 11:05:32.530053 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 6/13] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:05:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:05:32.594195 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-bf19c30c-3639-46ce-8b80-d1190ab89054 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:32.680010 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-bf19c30c-3639-46ce-8b80-d1190ab89054 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143970 Apr 05 11:05:32.680569 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 8/14] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Apr 5 11:05:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:05:32.692536 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-e0eff580-2616-4af0-914e-da6ba7529734 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:32.774726 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-e0eff580-2616-4af0-914e-da6ba7529734 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085763 Apr 05 11:05:32.775328 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 7/15] 10.222.0.39 () {64 vars in 1335 bytes} [Tue Apr 5 11:05:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:05:35.136542 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-bf19c30c-3639-46ce-8b80-d1190ab89054 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:35.137623 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-bf19c30c-3639-46ce-8b80-d1190ab89054 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Apr 05 11:05:35.138267 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 9/16] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:05:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:05:35.199306 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-62eb68b7-0918-4626-a641-0a622dc71879 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "name": "ds4G", "swap": 0}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:35.288500 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-62eb68b7-0918-4626-a641-0a622dc71879 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143068 Apr 05 11:05:35.289697 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 8/17] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Apr 5 11:05:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:05:35.301805 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-f42569b6-bf04-47ab-aab6-3b2407cbf6a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:35.409371 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-f42569b6-bf04-47ab-aab6-3b2407cbf6a6 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111080 Apr 05 11:05:35.409970 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 10/18] 10.222.0.39 () {64 vars in 1335 bytes} [Tue Apr 5 11:05:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:05:37.789972 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-62eb68b7-0918-4626-a641-0a622dc71879 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:37.791037 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-62eb68b7-0918-4626-a641-0a622dc71879 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Apr 05 11:05:37.791447 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 9/19] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:05:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:05:37.853780 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-9fd71014-bfd7-4998-954c-0826ae4bc4d4 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:37.878194 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-9fd71014-bfd7-4998-954c-0826ae4bc4d4 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078849 Apr 05 11:05:37.879431 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1291 bytes} [Tue Apr 5 11:05:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:05:40.763946 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-62eb68b7-0918-4626-a641-0a622dc71879 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:40.764997 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-62eb68b7-0918-4626-a641-0a622dc71879 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Apr 05 11:05:40.765377 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 10/21] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:05:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:05:40.837698 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-75280dea-3751-4f8b-bd87-4e9dfc21ea43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "vcpus": 1}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:40.918487 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-75280dea-3751-4f8b-bd87-4e9dfc21ea43 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.145906 Apr 05 11:05:40.919207 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 12/22] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Apr 5 11:05:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:05:40.935411 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-35ac8b16-7ec4-476f-8022-3703ff593993 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:41.049145 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-35ac8b16-7ec4-476f-8022-3703ff593993 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117998 Apr 05 11:05:41.049657 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 11/23] 10.222.0.39 () {64 vars in 1332 bytes} [Tue Apr 5 11:05:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:05:43.971727 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-75280dea-3751-4f8b-bd87-4e9dfc21ea43 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:43.973086 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-75280dea-3751-4f8b-bd87-4e9dfc21ea43 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Apr 05 11:05:43.973647 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:05:44.038374 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-18a20b97-edb7-4b25-93c5-bfd34b428d9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "ram": 2048}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:44.114133 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-18a20b97-edb7-4b25-93c5-bfd34b428d9e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.132341 Apr 05 11:05:44.114707 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 12/25] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Apr 5 11:05:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:05:44.130191 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-1a2e759c-053d-4450-a316-70f4447aaaf4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:44.203157 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-1a2e759c-053d-4450-a316-70f4447aaaf4 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078151 Apr 05 11:05:44.203779 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 14/26] 10.222.0.39 () {64 vars in 1332 bytes} [Tue Apr 5 11:05:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:05:46.555251 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-18a20b97-edb7-4b25-93c5-bfd34b428d9e admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:46.556184 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-18a20b97-edb7-4b25-93c5-bfd34b428d9e admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Apr 05 11:05:46.556584 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:05:46.615444 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-9b0ba615-ffaa-4e0f-a323-97448972d8a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 40}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:46.708304 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-9b0ba615-ffaa-4e0f-a323-97448972d8a8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.144972 Apr 05 11:05:46.708946 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 15/28] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Apr 5 11:05:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:05:46.721348 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-97a70f9d-5ce6-4144-b297-91598819451f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:46.809868 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-97a70f9d-5ce6-4144-b297-91598819451f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092478 Apr 05 11:05:46.810383 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 14/29] 10.222.0.39 () {64 vars in 1332 bytes} [Tue Apr 5 11:05:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:05:49.181588 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-9b0ba615-ffaa-4e0f-a323-97448972d8a8 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:49.182631 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-9b0ba615-ffaa-4e0f-a323-97448972d8a8 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Apr 05 11:05:49.183078 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:05:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:05:49.248170 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-cda469b8-e669-40e3-bfdb-c7f909755373 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "vcpus": 4, "id": "4", "rxtx_factor": 1.0}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:49.324127 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-cda469b8-e669-40e3-bfdb-c7f909755373 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.134400 Apr 05 11:05:49.324718 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 15/31] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Apr 5 11:05:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:05:49.336702 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-9bf677dc-4508-46e2-8727-2fc6bfb61de3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:49.408622 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-9bf677dc-4508-46e2-8727-2fc6bfb61de3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075731 Apr 05 11:05:49.409227 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 17/32] 10.222.0.39 () {64 vars in 1332 bytes} [Tue Apr 5 11:05:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:05:51.921315 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-cda469b8-e669-40e3-bfdb-c7f909755373 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:05:51.922332 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-cda469b8-e669-40e3-bfdb-c7f909755373 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Apr 05 11:05:51.922956 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:05:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:05:51.990252 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-91c43508-8850-4e7c-b78f-cf71b52427b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "swap": 0, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:52.073249 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-91c43508-8850-4e7c-b78f-cf71b52427b0 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.144041 Apr 05 11:05:52.073877 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 18/34] 10.222.0.39 () {64 vars in 1282 bytes} [Tue Apr 5 11:05:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:05:52.085809 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-11b06129-6f19-4702-b06e-85540316dbf9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:05:52.161334 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-11b06129-6f19-4702-b06e-85540316dbf9 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079169 Apr 05 11:05:52.162009 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 17/35] 10.222.0.39 () {64 vars in 1332 bytes} [Tue Apr 5 11:05:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:06:15.476326 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-91c43508-8850-4e7c-b78f-cf71b52427b0 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:15.477330 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-91c43508-8850-4e7c-b78f-cf71b52427b0 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Apr 05 11:06:15.477729 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:06:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:06:15.534711 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-b0b240c2-c369-469f-9c95-e92ab225f36f admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:15.552326 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-b0b240c2-c369-469f-9c95-e92ab225f36f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068143 Apr 05 11:06:15.552798 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1291 bytes} [Tue Apr 5 11:06:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:06:16.931926 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-91c43508-8850-4e7c-b78f-cf71b52427b0 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:16.933415 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-91c43508-8850-4e7c-b78f-cf71b52427b0 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 Apr 05 11:06:16.933808 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Apr 5 11:06:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:06:17.132458 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-ef1f5234-92fa-4032-b76d-3cb4649476d3 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:17.138090 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.wsgi [None req-ef1f5234-92fa-4032-b76d-3cb4649476d3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 05 11:06:17.138587 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-ef1f5234-92fa-4032-b76d-3cb4649476d3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:06:17.139858 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-ef1f5234-92fa-4032-b76d-3cb4649476d3 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057818 Apr 05 11:06:17.141038 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Apr 5 11:06:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:06:17.150203 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-6be8c2d8-05a1-4533-8731-72c2770e469f admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:17.171844 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-6be8c2d8-05a1-4533-8731-72c2770e469f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025173 Apr 05 11:06:17.179478 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Apr 5 11:06:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:06:17.182929 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-f2e98865-b33f-43c7-b381-22ff5a3b6628 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:17.204194 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-f2e98865-b33f-43c7-b381-22ff5a3b6628 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025386 Apr 05 11:06:17.204743 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Apr 5 11:06:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:06:17.214221 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-b323cd02-a5d3-4130-b2b6-9c1b31b3414d admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:17.219807 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.wsgi [None req-b323cd02-a5d3-4130-b2b6-9c1b31b3414d admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 05 11:06:17.220377 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-b323cd02-a5d3-4130-b2b6-9c1b31b3414d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:06:17.221168 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-b323cd02-a5d3-4130-b2b6-9c1b31b3414d admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010644 Apr 05 11:06:17.221668 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Apr 5 11:06:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:06:18.486917 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-f2e98865-b33f-43c7-b381-22ff5a3b6628 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:18.487917 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-f2e98865-b33f-43c7-b381-22ff5a3b6628 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Apr 05 11:06:18.488306 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Apr 5 11:06:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:06:18.677685 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-42c6246c-a0f4-41e8-9b1e-1f9071f7b012 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:18.683490 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.wsgi [None req-42c6246c-a0f4-41e8-9b1e-1f9071f7b012 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 05 11:06:18.684043 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-42c6246c-a0f4-41e8-9b1e-1f9071f7b012 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:06:18.684828 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-42c6246c-a0f4-41e8-9b1e-1f9071f7b012 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058431 Apr 05 11:06:18.685341 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Apr 5 11:06:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:06:18.694848 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-66e95a15-d002-4e3a-ac96-053d6d15f5b5 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:18.708955 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-66e95a15-d002-4e3a-ac96-053d6d15f5b5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017754 Apr 05 11:06:18.709473 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Apr 5 11:06:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:06:18.718855 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-325dbdd5-ce43-4ce3-aeb7-423f3cf60309 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:18.732223 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-325dbdd5-ce43-4ce3-aeb7-423f3cf60309 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016903 Apr 05 11:06:18.732750 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Apr 5 11:06:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:06:18.741760 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-fb1d3c99-6581-4aad-b353-f168c616d621 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:18.747688 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.wsgi [None req-fb1d3c99-6581-4aad-b353-f168c616d621 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 05 11:06:18.748301 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-fb1d3c99-6581-4aad-b353-f168c616d621 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:06:18.749086 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-fb1d3c99-6581-4aad-b353-f168c616d621 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010861 Apr 05 11:06:18.749593 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Apr 5 11:06:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:06:20.000286 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-325dbdd5-ce43-4ce3-aeb7-423f3cf60309 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:20.001306 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-325dbdd5-ce43-4ce3-aeb7-423f3cf60309 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Apr 05 11:06:20.001678 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 25/48] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Apr 5 11:06:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:06:20.189377 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-203f723f-592b-49b9-92f9-61135ae1186e admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:20.194761 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.wsgi [None req-203f723f-592b-49b9-92f9-61135ae1186e admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 05 11:06:20.195317 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-203f723f-592b-49b9-92f9-61135ae1186e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:06:20.196093 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-203f723f-592b-49b9-92f9-61135ae1186e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058233 Apr 05 11:06:20.196603 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Apr 5 11:06:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:06:20.206576 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-38b4d22c-593e-4671-8790-cd5b7ad16918 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:20.219982 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-38b4d22c-593e-4671-8790-cd5b7ad16918 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016990 Apr 05 11:06:20.220523 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Apr 5 11:06:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:06:20.230854 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:20.243910 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017440 Apr 05 11:06:20.244952 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 25/51] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Apr 5 11:06:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:06:20.254364 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-9c325695-4c55-4abf-82d9-bbee9ac4863b admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:20.259632 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.wsgi [None req-9c325695-4c55-4abf-82d9-bbee9ac4863b admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 05 11:06:20.260242 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-9c325695-4c55-4abf-82d9-bbee9ac4863b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:06:20.261023 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-9c325695-4c55-4abf-82d9-bbee9ac4863b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010321 Apr 05 11:06:20.261526 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 27/52] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Apr 5 11:06:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 11:06:21.525131 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:21.526676 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Apr 05 11:06:21.527079 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Apr 5 11:06:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:06:21.716125 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-1acde4c8-1c0c-4f82-a963-46f0fe2bbd24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:06:21.804375 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-1acde4c8-1c0c-4f82-a963-46f0fe2bbd24 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.139796 Apr 05 11:06:21.804914 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 28/54] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Apr 5 11:06:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:06:23.075096 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:23.076100 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Apr 05 11:06:23.076500 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Apr 5 11:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:06:23.280550 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-6abffe45-ff23-4d2b-9e24-aa99250c85d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:06:23.352360 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-6abffe45-ff23-4d2b-9e24-aa99250c85d9 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.122514 Apr 05 11:06:23.352951 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 29/56] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Apr 5 11:06:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:06:24.643710 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:24.644710 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Apr 05 11:06:24.645105 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Apr 5 11:06:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:06:24.833285 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-160c606e-6304-4b84-ac70-5e2b8072946c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:06:24.923130 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-160c606e-6304-4b84-ac70-5e2b8072946c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.140853 Apr 05 11:06:24.923625 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 30/58] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Apr 5 11:06:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:06:26.197484 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:26.198509 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Apr 05 11:06:26.198946 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 29/59] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Apr 5 11:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:06:26.391753 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-54e27200-f0e3-4ed4-a3e9-7115e691dd78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:06:26.465033 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-54e27200-f0e3-4ed4-a3e9-7115e691dd78 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.124290 Apr 05 11:06:26.466287 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Apr 5 11:06:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:06:27.726966 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:27.727964 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Apr 05 11:06:27.728974 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Apr 5 11:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:06:27.915967 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-7cf52b43-bf2d-4fa8-8b13-02ed198d1c48 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:06:27.934637 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-7cf52b43-bf2d-4fa8-8b13-02ed198d1c48 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070096 Apr 05 11:06:27.935187 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 32/62] 10.222.0.39 () {60 vars in 1202 bytes} [Tue Apr 5 11:06:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:07:21.892259 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:07:21.893249 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-20cb3efe-820d-4aa1-825a-697dbeb6e056 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Apr 05 11:07:21.893650 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 31/63] 10.222.0.39 () {54 vars in 930 bytes} [Tue Apr 5 11:07:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:07:21.952463 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-77e0436f-5051-42c7-b96d-485d4565d061 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:07:21.972100 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-77e0436f-5051-42c7-b96d-485d4565d061 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071715 Apr 05 11:07:21.972657 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1291 bytes} [Tue Apr 5 11:07:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:07:21.996309 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-a88edead-fb05-4fee-b13b-457ae45e2b5e admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:07:22.004153 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-a88edead-fb05-4fee-b13b-457ae45e2b5e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012799 Apr 05 11:07:22.004698 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1282 bytes} [Tue Apr 5 11:07:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:07:22.016468 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-ff513ebe-0a58-47ce-bf5a-8f55450ac563 admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:07:22.024179 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-ff513ebe-0a58-47ce-bf5a-8f55450ac563 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011604 Apr 05 11:07:22.024706 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1285 bytes} [Tue Apr 5 11:07:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:07:22.035850 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-2e1ff19f-769e-4f11-8884-89a8a9daaf01 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:07:22.043817 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-2e1ff19f-769e-4f11-8884-89a8a9daaf01 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011547 Apr 05 11:07:22.044331 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1285 bytes} [Tue Apr 5 11:07:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:07:22.055935 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-55657039-ee04-44af-b91a-3faeab78a42c admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:07:22.063524 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-55657039-ee04-44af-b91a-3faeab78a42c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011823 Apr 05 11:07:22.064049 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1282 bytes} [Tue Apr 5 11:07:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:09:23.852767 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-309a9173-3d00-4554-9cba-bd696380ab0c tempest-verify_tempest_config-606464412 tempest-verify_tempest_config-606464412-project] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:09:23.854747 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-309a9173-3d00-4554-9cba-bd696380ab0c tempest-verify_tempest_config-606464412 tempest-verify_tempest_config-606464412-project] 10.222.0.39 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106467 Apr 05 11:09:23.855282 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 34/69] 10.222.0.39 () {58 vars in 1133 bytes} [Tue Apr 5 11:09:23 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:11:10.624482 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-55657039-ee04-44af-b91a-3faeab78a42c admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:11:10.632846 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-55657039-ee04-44af-b91a-3faeab78a42c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Apr 05 11:11:10.632846 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 36/70] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Apr 5 11:11:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:11:10.929117 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-fc0f272b-9caa-4afb-934d-34eebd5a7aa0 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:11:10.930551 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:11:10.930551 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: warnings.warn(msg) Apr 05 11:11:10.932019 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-fc0f272b-9caa-4afb-934d-34eebd5a7aa0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:11:10.932510 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-fc0f272b-9caa-4afb-934d-34eebd5a7aa0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:11:10.933363 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-fc0f272b-9caa-4afb-934d-34eebd5a7aa0 admin admin] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:11:10.933936 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-fc0f272b-9caa-4afb-934d-34eebd5a7aa0 admin admin] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:11:10.976282 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-fc0f272b-9caa-4afb-934d-34eebd5a7aa0 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.192702 Apr 05 11:11:10.977083 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 35/71] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Apr 5 11:11:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:11:12.934719 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-55657039-ee04-44af-b91a-3faeab78a42c admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:11:12.935918 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-55657039-ee04-44af-b91a-3faeab78a42c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 Apr 05 11:11:12.936417 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 37/72] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Apr 5 11:11:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:11:13.160202 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-a4cd8b7e-e9d5-4d47-b350-dc4066c2a069 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:11:13.162577 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:11:13.162577 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: warnings.warn(msg) Apr 05 11:11:13.163800 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-a4cd8b7e-e9d5-4d47-b350-dc4066c2a069 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:11:13.164514 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-a4cd8b7e-e9d5-4d47-b350-dc4066c2a069 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:11:13.165800 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-a4cd8b7e-e9d5-4d47-b350-dc4066c2a069 admin admin] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:11:13.166541 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-a4cd8b7e-e9d5-4d47-b350-dc4066c2a069 admin admin] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:11:13.189977 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-a4cd8b7e-e9d5-4d47-b350-dc4066c2a069 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.094065 Apr 05 11:11:13.190561 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 36/73] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Apr 5 11:11:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:11:24.929068 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-55657039-ee04-44af-b91a-3faeab78a42c admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:11:24.930974 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-55657039-ee04-44af-b91a-3faeab78a42c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002635 Apr 05 11:11:24.931755 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 38/74] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Apr 5 11:11:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:11:25.131552 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-980a4ebc-e869-4465-93fd-e1ed7222213c admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:11:25.133768 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:11:25.133768 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: warnings.warn(msg) Apr 05 11:11:25.135950 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-980a4ebc-e869-4465-93fd-e1ed7222213c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:11:25.136738 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-980a4ebc-e869-4465-93fd-e1ed7222213c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:11:25.138173 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-980a4ebc-e869-4465-93fd-e1ed7222213c admin admin] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:11:25.138942 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-980a4ebc-e869-4465-93fd-e1ed7222213c admin admin] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:11:25.185381 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-980a4ebc-e869-4465-93fd-e1ed7222213c admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.113999 Apr 05 11:11:25.186363 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 37/75] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Apr 5 11:11:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:11:26.508781 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: DEBUG nova.api.openstack.wsgi [None req-55657039-ee04-44af-b91a-3faeab78a42c admin admin] Calling method '>' {{(pid=103221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:11:26.509824 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: INFO nova.api.openstack.requestlog [None req-55657039-ee04-44af-b91a-3faeab78a42c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Apr 05 11:11:26.510237 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: [pid: 103221|app: 0|req: 39/76] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Apr 5 11:11:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:11:26.709866 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG nova.api.openstack.wsgi [None req-40b9a96f-6810-483a-9057-b51b33c26e87 admin admin] Calling method '>' {{(pid=103222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:11:26.711681 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:11:26.711681 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: warnings.warn(msg) Apr 05 11:11:26.713438 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-40b9a96f-6810-483a-9057-b51b33c26e87 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:11:26.714159 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-40b9a96f-6810-483a-9057-b51b33c26e87 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:11:26.715507 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-40b9a96f-6810-483a-9057-b51b33c26e87 admin admin] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:11:26.716202 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: DEBUG oslo_concurrency.lockutils [None req-40b9a96f-6810-483a-9057-b51b33c26e87 admin admin] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:11:26.751553 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: INFO nova.api.openstack.requestlog [None req-40b9a96f-6810-483a-9057-b51b33c26e87 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.100802 Apr 05 11:11:26.752577 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: [pid: 103222|app: 0|req: 38/77] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Apr 5 11:11:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:12:28.628104 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: Tue Apr 5 11:12:28 2022 - graceful shutdown triggered... Apr 05 11:12:28.628710 dv-cinder-818994-3-iscsi devstack@n-api.service[103222]: Gracefully killing worker 2 (pid: 103222)... Apr 05 11:12:28.628192 dv-cinder-818994-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 05 11:12:28.630530 dv-cinder-818994-3-iscsi devstack@n-api.service[103221]: Gracefully killing worker 1 (pid: 103221)... Apr 05 11:12:29.629170 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: worker 1 buried after 1 seconds Apr 05 11:12:29.629170 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: worker 2 buried after 1 seconds Apr 05 11:12:29.629170 dv-cinder-818994-3-iscsi devstack@n-api.service[103220]: goodbye to uWSGI. Apr 05 11:12:29.630737 dv-cinder-818994-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 05 11:12:29.631329 dv-cinder-818994-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 05 11:12:29.634086 dv-cinder-818994-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 05 11:12:29.723843 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 5 11:12:29 2022] *** Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: nodename: dv-cinder-818994-3-iscsi Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: machine: x86_64 Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: clock source: unix Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: pcre jit disabled Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: detected number of CPU cores: 4 Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: current working directory: / Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: detected binary path: /usr/bin/uwsgi-core Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: your processes number limit is 47680 Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: your memory page size is 4096 bytes Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: detected max file descriptor number: 2048 Apr 05 11:12:29.742339 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: lock engine: pthread robust mutexes Apr 05 11:12:29.744130 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: thunder lock: enabled Apr 05 11:12:29.744130 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 05 11:12:29.744130 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 05 11:12:29.788550 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: Python main interpreter initialized at 0x5654918f59c0 Apr 05 11:12:29.788550 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: python threads support enabled Apr 05 11:12:29.788550 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: your server socket listen backlog is limited to 100 connections Apr 05 11:12:29.788550 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: your mercy for graceful operations on workers is 90 seconds Apr 05 11:12:29.789005 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: mapped 403077 bytes (393 KB) for 2 cores Apr 05 11:12:29.789005 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: *** Operational MODE: preforking *** Apr 05 11:12:29.789263 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: *** uWSGI is running in multiple interpreter mode *** Apr 05 11:12:29.789263 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: spawned uWSGI master process (pid: 117579) Apr 05 11:12:29.789539 dv-cinder-818994-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 05 11:12:29.790082 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: spawned uWSGI worker 1 (pid: 117593, cores: 1) Apr 05 11:12:29.790446 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: spawned uWSGI worker 2 (pid: 117594, cores: 1) Apr 05 11:12:29.790729 dv-cinder-818994-3-iscsi devstack@n-api.service[117579]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 05 11:12:31.087139 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 11:12:31.157334 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 05 11:12:32.082021 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:12:32.082021 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: from cryptography.utils import int_from_bytes Apr 05 11:12:32.082769 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:12:32.082769 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: from cryptography.utils import int_from_bytes Apr 05 11:12:32.310859 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:12:32.310859 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: from cryptography.utils import int_from_bytes Apr 05 11:12:32.311800 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:12:32.311800 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: from cryptography.utils import int_from_bytes Apr 05 11:12:34.621408 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:12:34.622127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 11:12:34.622127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:12:34.623265 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 11:12:34.623265 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 11:12:34.624234 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.624234 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.624544 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.624706 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.625113 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.625288 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.625583 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.625918 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.626257 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.626518 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.626892 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.627182 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818994-3-iscsi {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.627521 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.627840 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.628163 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.628491 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.629078 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.629411 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.629728 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.630284 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.630768 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.631090 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.631420 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.631772 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.632097 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.632451 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.632748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.633071 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.633404 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.633743 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.634167 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818994-3-iscsi {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.634477 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.634832 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.635162 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.635623 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.635947 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.636273 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.636609 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.636945 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.637318 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.637614 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.637946 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.638278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.638683 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.639507 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.639831 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.640177 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.640507 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.640828 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.641145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.641434 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.641756 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.642090 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.642425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.642786 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.643050 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.643310 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.643645 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.643978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.644420 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.644621 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.644923 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.645239 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.645556 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.645876 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.646194 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.646537 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.646867 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.647219 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.647540 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.647868 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.648448 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.648621 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.648863 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.649184 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.649530 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.649864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.650183 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.650515 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.650870 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.651193 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.651517 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.651862 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.652192 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.652545 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.653009 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.653282 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.653629 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.653950 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.654281 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.654780 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.654939 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.655284 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.655597 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.655913 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.656231 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.656547 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.656863 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.657181 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.657498 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.657814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.658130 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.658445 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.658914 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.659227 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.659530 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.659845 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.660152 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.660473 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.660811 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.661112 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.661434 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.661787 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.662108 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.662423 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.662777 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.663097 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.663414 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.663745 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.664057 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.664376 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.664703 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.665104 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.665385 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.665640 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.665954 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.666268 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.666583 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.666943 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.667264 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.667564 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.667909 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.668238 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.668559 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.668878 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.669264 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.669595 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.669947 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.670288 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.670672 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.670984 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.671332 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.671673 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.672000 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.672323 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.672647 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.672981 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.673328 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.673650 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.673976 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.674330 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.674675 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.675014 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.675479 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.675743 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.675968 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.676311 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.676639 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.676977 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.677409 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.677617 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.677969 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.678323 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.678664 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.679002 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.679357 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.679675 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.680061 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.680309 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.680689 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.680976 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.681301 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.681629 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.681948 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.682269 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.682589 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.682932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.683277 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.683629 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.683955 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.684279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.684599 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.685564 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.685754 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.686071 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.686389 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.686836 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.687022 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.687334 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.687654 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.687991 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.688317 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.688653 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.688990 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.689338 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.689655 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.689990 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.690310 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.690953 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.690953 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.691358 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.691571 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.691886 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.692217 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.692531 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.692867 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.693198 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.693512 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.693826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.694152 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.694475 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.694852 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.695174 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.695493 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.695907 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.696166 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.696441 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.696968 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.697132 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.697441 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.697776 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.698107 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.698431 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.698785 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.699110 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.699419 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.699732 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.700044 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.702392 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.702392 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.702392 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.702392 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.702392 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.703228 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.703228 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.703228 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.703667 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.703821 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.704002 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.704376 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.704692 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.705044 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.705391 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.705721 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.706153 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.706411 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.706710 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.707099 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.707348 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.707669 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.707989 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.708320 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.708711 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.709085 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.709611 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.710200 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.710837 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.711479 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.712070 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.712652 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.713325 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.713971 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.714553 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.715180 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.715667 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.716295 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.716695 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.717247 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.717814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.718385 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.718756 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.719252 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.719835 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.720427 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.721079 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.721448 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.722010 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.722171 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.722491 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.722921 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.723254 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.723574 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.723906 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.724248 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.724602 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.724938 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.725264 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.725588 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.725912 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.726518 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.726928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.726928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.727499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.727670 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.727990 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.728207 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.728526 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.728867 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.729133 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.729479 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.729833 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.730170 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.730508 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.730891 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.731216 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.731557 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.731921 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.732243 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.732565 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.733009 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.733270 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.733594 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.733914 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.734246 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.734581 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.734932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.735264 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.735587 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.735909 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.736250 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.736744 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.736937 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.737194 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.737583 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.737840 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.738301 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.738654 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.738965 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.739223 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.739558 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.739877 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.740201 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.740534 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.741149 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.741505 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.741837 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.742170 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.742503 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.742867 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.743282 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.743550 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.744085 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.744414 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.744766 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.745088 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.745409 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.745736 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.746057 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.746376 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.746967 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.747169 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.748168 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.748323 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.748514 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.748835 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.749168 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.749482 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.749808 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.750125 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.750498 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.750854 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.751172 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.751490 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.751812 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.752172 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.752491 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.752846 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.753367 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.753534 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.754095 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.754471 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.754835 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.755156 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.755573 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.755786 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.756108 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.756458 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.756779 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.757253 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.757418 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.757731 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.758292 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.758470 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.758692 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.759014 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.759343 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.759665 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.759979 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.760805 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.760805 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.761161 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.761338 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.761680 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.761919 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.762190 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.762507 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.762885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.763235 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.763643 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.763866 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.764182 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.764526 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.764850 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.765168 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.765514 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.765838 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.766154 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.766469 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.766818 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.767157 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.767488 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.767841 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.768098 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.768596 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.768751 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.769116 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.769339 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.769656 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.769973 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.770288 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.770664 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.770977 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.771321 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.771644 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.771966 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.772283 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.772596 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.772954 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.773298 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.773731 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.773986 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.774312 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.774655 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.774982 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.775303 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.775631 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.775946 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.776278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.776588 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.776913 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.777226 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.777618 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.777952 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.778194 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.779347 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.779538 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.779873 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.780082 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.780400 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.780723 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.781047 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.781368 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.781689 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.782008 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.782338 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.782687 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.783017 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.783338 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.783675 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.784074 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.784323 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.784649 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.784965 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.785313 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.785637 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.785955 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.786276 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.786593 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.786946 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.787266 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.787843 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.788038 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.788380 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.788701 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.789021 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.789524 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.789698 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.789984 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.790283 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.790749 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.791083 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.791382 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.791706 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.792020 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.792340 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.792664 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.793001 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.793316 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.793666 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.794238 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.794464 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.794835 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.795172 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.795617 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.795981 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.796263 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.796693 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.797016 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.797844 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.798175 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.798496 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.798863 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.799183 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.799695 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.799874 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.800163 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.800482 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.800808 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.801137 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.801455 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.801792 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.802127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.802465 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.802852 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.803309 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.803648 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.803977 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.804435 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.804655 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.804973 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.805292 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.805621 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.805939 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.806259 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.806601 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.806945 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.807272 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.807594 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.807918 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.808340 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.808706 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.808899 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.809226 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.809629 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.810066 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.810370 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.810571 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.810940 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.811281 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.811606 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.811928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.812252 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.812571 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.812936 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.813255 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.813590 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.813937 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.814279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.814826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.815003 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.815318 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.815650 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.815982 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.816321 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.816637 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.816954 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.817279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.817598 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.817917 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.818233 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.818662 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.819004 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.819186 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.819495 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.819839 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.820236 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.820535 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.820780 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.821098 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.821416 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.821733 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.822094 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.822415 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.822879 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.823218 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.823547 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.823907 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.824234 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.824810 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.824983 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.825220 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.825584 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.825916 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.826250 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.826594 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.826959 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.827284 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.827634 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.827981 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.828290 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.828887 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.829214 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.829545 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.829954 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.830358 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.830551 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.830871 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.831326 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.831489 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.831797 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.832120 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.832473 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.832809 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.833154 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.833506 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.833840 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.834168 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.834496 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.834933 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.835226 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.835556 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.835876 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.836204 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.836534 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.836861 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.837188 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.837514 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.837846 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.838172 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.838534 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.839022 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.839218 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.839663 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.839899 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.840251 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.840641 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.840932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.841752 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.842084 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.842692 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.843030 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.843381 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.843722 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.844062 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.844393 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.844726 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.845073 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.845390 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.845708 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.846032 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.846352 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.846693 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.847038 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.847363 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.847684 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.848016 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.848338 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.848935 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.849303 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.849637 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.849968 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.850308 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.850759 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.851093 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.851314 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.851632 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.851950 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.852278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.852600 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.852922 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.853236 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.853561 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.853883 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.854199 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.854519 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.854866 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.855223 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.855540 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.855855 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.856170 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.856492 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.856884 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.857202 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.857521 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.857836 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.858163 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.858480 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.858832 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.859152 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.859506 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.859839 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.860137 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.860464 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.860916 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.861247 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.861435 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.861766 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.862129 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.862408 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.862765 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.863093 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.863460 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.864456 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.864456 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.864804 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.865040 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.865396 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.865736 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.866054 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.866372 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.866711 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.867050 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.867371 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.867692 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.868012 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.868331 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.868651 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.868972 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.869136 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:12:34.869829 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.869986 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 05 11:12:34.870409 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.870734 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:12:34.871889 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.871889 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.872914 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 05 11:12:34.872914 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 05 11:12:34.873213 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.873213 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.873519 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.873676 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.873832 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.873988 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.874144 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.874299 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.874446 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.874645 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.874801 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.874959 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.875114 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.875261 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.875457 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.875733 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.875884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.876038 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.876185 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.876185 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.876531 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.876691 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.876838 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.876983 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818994-3-iscsi {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.877139 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.877286 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.877455 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.877615 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.877771 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.877926 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.878082 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.878244 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.878401 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.878851 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.879008 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.879155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.879300 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.879461 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.879616 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.879776 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.880127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.880307 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.880749 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.881027 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.881413 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.881706 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.881876 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.882040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.882210 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.882365 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.882541 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.882753 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.882931 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.883205 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.883381 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.883537 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.883699 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.883863 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.884017 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.884180 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.884350 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.884514 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818994-3-iscsi {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.884688 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.884850 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.885016 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.885170 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.885322 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.885483 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.885645 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.885645 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.886102 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.886102 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.886406 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.886567 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.886786 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.886954 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.887123 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.887278 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.887450 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.887613 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.887766 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.887766 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.888152 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.888315 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.888468 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.888630 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.888792 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.888955 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.889129 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.889293 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.889457 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.890410 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.890624 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.891337 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.891744 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.892019 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.892179 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.892344 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.892499 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.892666 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.892851 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.892851 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.893185 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.893455 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.893615 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.893785 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.893948 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.894104 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.894270 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.894434 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.894644 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.894819 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.894997 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.895152 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.895315 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.895470 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.895640 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.895852 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.896151 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.896320 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.896484 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.896650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.896803 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.896974 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.897149 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.897310 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.897473 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.897648 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.897812 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.897980 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.898142 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.898304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.898304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.898691 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.898853 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.899018 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.899173 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.899345 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.899513 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.899668 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.899830 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.899983 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.900143 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.900297 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.900297 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.900775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.901074 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.901501 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.901501 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.902175 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.902367 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.902524 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.902714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.902885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.903040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.903202 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.903373 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.904193 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.904353 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.904507 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.904670 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.904835 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.905003 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.905157 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.905310 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.905471 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.905635 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.905797 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.905960 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.906136 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.906409 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.906569 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.906786 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.906944 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.907098 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.907274 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.907428 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.907590 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.907755 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.907925 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.908089 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.908253 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.908415 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.908569 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.908689 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.908774 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.908944 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.908944 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.909116 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.909204 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.909357 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.909446 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.909607 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.909769 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.909923 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.910090 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.910253 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.910408 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.910560 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.910967 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.911260 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.911564 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.912147 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.912431 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.912591 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 11:12:34.912746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.912746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.912746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.912746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.912746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.912746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.912746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.912746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.913920 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.913920 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.913920 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.913920 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.913920 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.913920 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.913920 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.913920 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.915879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.915879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.915879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.915879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.915879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.915879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.915879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.915879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.917199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.917199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.917199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.917199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.917199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.917199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.917199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.917199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.918339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.918339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 05 11:12:34.918339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.918339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.918339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.918339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.918339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.918339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.920138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.920138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.920138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.920138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.920138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.920138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.920138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.920138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.921764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.921764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.921764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.921764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.921764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.921764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.921764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.921764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.923535 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.923535 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.923535 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.923535 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.923535 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.923535 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.924631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.924631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.924631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.924631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.925224 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.925224 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.925909 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.925909 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.926222 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.926446 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.926764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.927092 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.927404 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.927735 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.928110 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.928361 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.928680 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.928997 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.929311 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.929633 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.929922 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.930244 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.930534 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.930883 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.931350 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.931670 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_db.sqlalchemy.engines [None req-7836411d-0a13-4c68-a2c9-10123e4bbc60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:12:34.931983 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.931983 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.932884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.932884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.932884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.933338 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.933338 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.933677 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.933949 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.934257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.934758 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.934945 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.935256 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.935588 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.935958 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.936202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.936503 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.936816 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.937107 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.937427 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.937739 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.938052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.938362 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.938701 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.939034 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.939400 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.939650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.939986 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.940323 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.940631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.941873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.941873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.941873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.941873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.943211 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.943211 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.943211 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.943211 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.943825 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.943825 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.944129 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.944289 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.944579 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.944884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.945213 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.945525 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.945833 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.946142 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.946449 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.946829 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.947141 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.947485 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.947824 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.948146 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.948471 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.948785 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.949102 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.949416 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.949732 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.950047 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.950914 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.951245 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.951560 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.951903 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.952348 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.952520 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.953139 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.953139 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.953613 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.953774 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.954077 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.954416 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.954838 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.955142 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.955395 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.956330 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.956330 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.956330 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.956816 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.956977 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.957289 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.957544 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.957866 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.958177 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.958509 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.958852 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.959173 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.959479 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.959797 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.960131 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.960466 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.960780 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.961093 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.961417 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.961729 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.962078 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.962850 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.962850 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.963503 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.963503 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.963850 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.964111 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.964280 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.964473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.964788 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.965210 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.965408 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.965714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.966098 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.966430 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.966771 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.967097 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.967439 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.967723 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.969169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.969169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.969169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.969169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.969814 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.969814 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.970160 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.970160 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.970480 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.970782 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.971103 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.971414 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.971732 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.972051 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.972355 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.972751 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.972972 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.973373 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.973786 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.973955 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.974287 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.974491 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.974842 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.975154 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.975465 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.975775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.976081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.976417 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.976707 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.977295 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.977631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.977945 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.978263 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.978582 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.978927 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.979262 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.979590 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.979931 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.980238 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.980588 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.980853 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.981156 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.981469 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.982425 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.982650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.983035 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.983239 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.983558 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.983982 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.984160 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.984482 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.984741 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.985047 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.985360 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.985665 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.985991 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.986299 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.986630 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.986930 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.987235 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.987579 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.987879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.988212 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.988540 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.988881 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.989188 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.989493 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.989819 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.990124 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.990429 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.990759 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.991072 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.991417 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.991893 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.992078 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.992293 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.992612 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.993133 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.993320 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.993516 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.993860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.994262 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.994430 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.994768 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.995040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.996146 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.996146 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.996146 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.997328 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.997328 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.997328 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.997328 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.998084 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.998084 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.998580 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.998580 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.999113 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.999113 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.999435 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.999667 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:34.999972 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.000286 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.000592 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.000753 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.context [None req-7836411d-0a13-4c68-a2c9-10123e4bbc60 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc(cell1) {{(pid=117594) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 11:12:35.000923 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.001196 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.001523 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.001842 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.002146 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.002464 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.002813 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.003289 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.003461 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.004049 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.005853 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.005853 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.005853 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.005853 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.005853 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.006861 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7836411d-0a13-4c68-a2c9-10123e4bbc60 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:12:35.007040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.007040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.007040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.007040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.007040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.007812 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.007979 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7836411d-0a13-4c68-a2c9-10123e4bbc60 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:12:35.008282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.008282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.008282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.008748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7836411d-0a13-4c68-a2c9-10123e4bbc60 None None] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:12:35.008915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.008915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.009221 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.009437 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.009717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.010024 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.010296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7836411d-0a13-4c68-a2c9-10123e4bbc60 None None] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:12:35.010464 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.010655 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.010969 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.011279 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.011586 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.011915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.012230 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.012549 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.013650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.013840 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.014033 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.015216 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.015216 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.015216 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.015676 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.015676 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.016160 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.016160 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.016582 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.016901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.017121 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.017371 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.018002 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.018002 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.018489 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.018693 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.018938 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.019233 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.019881 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.019881 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.020155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.020466 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.020775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.021218 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.021534 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.021851 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.022156 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.022476 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.022790 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_db.sqlalchemy.engines [None req-7836411d-0a13-4c68-a2c9-10123e4bbc60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:12:35.022932 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.023260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.023610 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.023962 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.024248 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.024463 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.024780 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.024940 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_db.sqlalchemy.engines [None req-7836411d-0a13-4c68-a2c9-10123e4bbc60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:12:35.025092 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.025401 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.025696 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.026007 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.026346 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.026672 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.026983 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.027289 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.027613 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.027930 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.028246 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.028737 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.029056 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.029364 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.029785 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.030099 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.030410 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.030759 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.031081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.031408 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.031718 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.032034 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.032345 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.032676 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.032998 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.033291 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.033616 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.033923 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.034249 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.034570 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.034911 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.035232 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.035657 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.035986 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.036301 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.036639 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.036965 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.037272 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.037578 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.037891 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.038197 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.038503 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.038878 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.039147 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.039458 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.039770 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.040081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.040387 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.040705 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.041010 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.041319 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.041643 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.041962 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.042285 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.042642 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.042928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.043274 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.043585 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.043974 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.044703 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.045024 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.045439 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.045668 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.046043 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.046308 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.046800 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.047022 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.047311 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.047644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.047962 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.048284 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.048608 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.048914 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.049239 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.049587 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.049826 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.050134 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.050439 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.050775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.051078 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.051399 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.051703 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.052041 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.052344 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.052667 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.052993 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.053297 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.053606 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.053921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.054266 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.054571 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.054989 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.055280 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.055600 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.055942 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.056257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.056586 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.056909 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.057292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.057557 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.057873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.058191 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.058506 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.058847 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.059162 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.059480 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.059860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.060672 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.061248 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.061689 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.061900 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.062214 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.062529 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.062877 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.063198 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.063515 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.063830 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.064144 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.064458 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.064791 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.065117 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.065445 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.065788 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.066111 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.066429 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.066771 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.067093 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.067457 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.067964 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.068112 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.068433 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.068754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.069072 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.069388 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.069703 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.070020 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.070335 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.070674 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.070989 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.071305 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.071625 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.071949 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.072287 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.072610 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.072949 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.073249 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.073568 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.074139 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.074457 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.074844 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.075174 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.075537 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.075860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.076186 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.077422 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.077422 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.077422 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.077422 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.077925 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.078048 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.078350 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.079062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.079062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.079424 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.079623 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.080202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.080556 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.080981 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.081208 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.081538 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.081863 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.082176 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.083180 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.083180 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.083180 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.083692 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.083856 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.084195 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.084507 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.084824 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.085171 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.085442 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.085756 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.086066 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.086400 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.087667 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.088023 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.088368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.088772 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.089025 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.089350 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.089670 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.089988 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.090314 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.090659 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.090996 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.091315 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.091632 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.091950 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.092272 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.092644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.092988 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.093303 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.093614 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.093943 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.094260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.094587 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.094932 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.095251 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.095610 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.095934 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.096528 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.096873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.097200 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.097548 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.097883 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.098209 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.098517 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.098860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.099192 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.099508 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.099824 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.100139 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.100453 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.100767 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.101084 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.101397 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.101709 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.102032 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.102342 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.102673 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.102995 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.103316 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.103665 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.103989 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.104309 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.104629 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.104944 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.105255 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.105570 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.105884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.106199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.106520 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.107419 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.107738 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.108050 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.108494 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.108809 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.109132 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.109455 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.109766 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.110091 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.110417 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.110753 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.111079 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.111402 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.111732 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.112077 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.112410 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.112742 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.113059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.113372 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.113681 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.113996 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.114334 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.114697 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.115020 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.115266 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.115580 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.115888 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.116196 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.116603 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.116810 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.117123 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.117430 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.118116 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.118116 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.118474 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.122181 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.123347 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.123347 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.123993 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.123993 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.124339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.124652 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.124977 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.125348 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.125699 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.126033 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.126368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.126728 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.127058 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.127380 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.127714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.128090 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.128388 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.129051 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.129371 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.129665 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.130507 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.130507 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.130889 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.131106 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.131278 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.131622 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.131960 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.132277 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.132615 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.132954 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.133516 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.133666 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.133936 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.134280 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.134636 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.134958 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.135421 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.135621 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.135970 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.136311 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.136640 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.136990 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.137327 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.137771 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.138033 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.138422 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.138818 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.139184 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.139513 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.139834 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.140152 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.140540 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 05 11:12:35.140725 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 05 11:12:35.165916 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_db.sqlalchemy.engines [None req-5713d633-3fbf-48a3-8ea5-0174f5719618 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:12:35.189355 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_db.sqlalchemy.engines [None req-7836411d-0a13-4c68-a2c9-10123e4bbc60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:12:35.232597 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.context [None req-5713d633-3fbf-48a3-8ea5-0174f5719618 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc(cell1) {{(pid=117593) load_cells /opt/stack/nova/nova/context.py:464}} Apr 05 11:12:35.237109 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5713d633-3fbf-48a3-8ea5-0174f5719618 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:12:35.238818 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5713d633-3fbf-48a3-8ea5-0174f5719618 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:12:35.239656 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5713d633-3fbf-48a3-8ea5-0174f5719618 None None] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:12:35.241660 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5713d633-3fbf-48a3-8ea5-0174f5719618 None None] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:12:35.257244 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_db.sqlalchemy.engines [None req-5713d633-3fbf-48a3-8ea5-0174f5719618 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:12:35.266253 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_db.sqlalchemy.engines [None req-5713d633-3fbf-48a3-8ea5-0174f5719618 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:12:35.583454 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_db.sqlalchemy.engines [None req-5713d633-3fbf-48a3-8ea5-0174f5719618 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 05 11:12:35.641532 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: WARNING keystonemiddleware.auth_token [None req-7836411d-0a13-4c68-a2c9-10123e4bbc60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:12:35.648701 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: WARNING keystonemiddleware.auth_token [None req-7836411d-0a13-4c68-a2c9-10123e4bbc60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:12:35.884349 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: WARNING keystonemiddleware.auth_token [None req-7836411d-0a13-4c68-a2c9-10123e4bbc60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:12:35.890387 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: WARNING keystonemiddleware.auth_token [None req-7836411d-0a13-4c68-a2c9-10123e4bbc60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:12:35.896078 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5654918f59c0 pid: 117594 (default app) Apr 05 11:12:36.127434 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: WARNING keystonemiddleware.auth_token [None req-5713d633-3fbf-48a3-8ea5-0174f5719618 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:12:36.134970 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: WARNING keystonemiddleware.auth_token [None req-5713d633-3fbf-48a3-8ea5-0174f5719618 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:12:36.381865 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: WARNING keystonemiddleware.auth_token [None req-5713d633-3fbf-48a3-8ea5-0174f5719618 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:12:36.387837 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: WARNING keystonemiddleware.auth_token [None req-5713d633-3fbf-48a3-8ea5-0174f5719618 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:12:36.393304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5654918f59c0 pid: 117593 (default app) Apr 05 11:13:20.787791 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-89ab778c-defb-481a-9a80-590922c13c71 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] Action: 'create', calling method: .version_select at 0x7fec0d6ee310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1186391172", "metadata": {"Type": "work"}}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:13:23.077300 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-89ab778c-defb-481a-9a80-590922c13c71 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.467458 Apr 05 11:13:23.078324 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1155 bytes} [Tue Apr 5 11:13:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3470 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 05 11:13:23.379071 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dd06d55e-f0f5-4a59-a98b-5cb9989e8682 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] Calling method '.version_select at 0x7fec0d75ab80>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:24.092168 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a73f369f-9eab-4e94-9cd9-78251ae0cf72 tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] Calling method '.version_select at 0x7fec0d5b7310>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:24.255710 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dd06d55e-f0f5-4a59-a98b-5cb9989e8682 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8afd8cc5-b6d4-4116-a388-8b8dfc497c00" status: 200 len: 353 microversion: 2.1 time: 1.167244 Apr 05 11:13:24.256591 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 1/2] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:13:23 2022] GET /compute/v2.1/os-volumes/8afd8cc5-b6d4-4116-a388-8b8dfc497c00 => generated 353 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:13:24.451320 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a73f369f-9eab-4e94-9cd9-78251ae0cf72 tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/a90d95c1-e836-4f69-8acc-ce04103ddb78" status: 200 len: 351 microversion: 2.1 time: 0.370709 Apr 05 11:13:24.453850 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:13:24 2022] GET /compute/v2.1/os-volumes/a90d95c1-e836-4f69-8acc-ce04103ddb78 => generated 351 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:13:24.494122 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-395578987", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "networks": [{"uuid": "fd4c078f-14f0-454e-a466-b883edc92fb1"}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:13:24.710660 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] validate_networks() for [('fd4c078f-14f0-454e-a466-b883edc92fb1', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:13:25.269135 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f499aed6-6a63-4c2f-9c0a-253b645a8f68 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] Calling method '.version_select at 0x7fec0d5b73a0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:25.360142 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f499aed6-6a63-4c2f-9c0a-253b645a8f68 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8afd8cc5-b6d4-4116-a388-8b8dfc497c00" status: 200 len: 354 microversion: 2.1 time: 0.094745 Apr 05 11:13:25.361122 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 3/4] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:13:25 2022] GET /compute/v2.1/os-volumes/8afd8cc5-b6d4-4116-a388-8b8dfc497c00 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:13:25.376636 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2259c759-61fb-432f-8586-1e30384859a2 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] Calling method '.version_select at 0x7fec0d5b7af0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:25.585836 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2259c759-61fb-432f-8586-1e30384859a2 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8afd8cc5-b6d4-4116-a388-8b8dfc497c00" status: 200 len: 354 microversion: 2.1 time: 0.213219 Apr 05 11:13:25.586502 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 4/5] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:13:25 2022] GET /compute/v2.1/os-volumes/8afd8cc5-b6d4-4116-a388-8b8dfc497c00 => generated 354 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:13:25.609679 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a56a08a7-9bf3-403d-82c6-b686b67f3e3b tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] Calling method '.version_select at 0x7fec0d5c81f0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:26.073876 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a56a08a7-9bf3-403d-82c6-b686b67f3e3b tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/8afd8cc5-b6d4-4116-a388-8b8dfc497c00" status: 202 len: 0 microversion: 2.1 time: 0.473774 Apr 05 11:13:26.076266 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 5/6] 10.222.0.39 () {58 vars in 1247 bytes} [Tue Apr 5 11:13:25 2022] DELETE /compute/v2.1/os-volumes/8afd8cc5-b6d4-4116-a388-8b8dfc497c00 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:13:26.084779 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b2959f0d-5ec2-470d-8faf-5f9347ce2dd6 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] Calling method '.version_select at 0x7fec0d5b7d30>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:26.543157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:13:26.543157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:13:26.543157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:13:26.543157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:13:26.543157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:13:26.562539 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:26.563361 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:26.564443 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:26.565084 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:26.815144 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Getting quotas for project 782ef6623f6b4e4c88f74aafdb472163. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:13:26.815144 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Getting quotas for user f0fb5d85f7cc4df69dfd84c1ae5a706e and project 782ef6623f6b4e4c88f74aafdb472163. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:13:26.815144 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:13:26.815144 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:13:26.831569 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b2959f0d-5ec2-470d-8faf-5f9347ce2dd6 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8afd8cc5-b6d4-4116-a388-8b8dfc497c00" status: 200 len: 353 microversion: 2.1 time: 0.705565 Apr 05 11:13:26.831569 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 6/7] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:13:26 2022] GET /compute/v2.1/os-volumes/8afd8cc5-b6d4-4116-a388-8b8dfc497c00 => generated 353 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:13:26.878161 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-383110ee-68a7-4787-b8a4-7ed6698d6177 tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] Calling method '.version_select at 0x7fec0d5b7160>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:27.024325 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1c7d61b9-406b-4b14-830c-f3b8cf177a28 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.626360 Apr 05 11:13:27.030360 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 2/8] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:13:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 11:13:27.048863 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-383110ee-68a7-4787-b8a4-7ed6698d6177 tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/bba194b1-04a2-41c8-b7ad-a1215d100e0e" status: 200 len: 350 microversion: 2.1 time: 0.175230 Apr 05 11:13:27.056317 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 7/9] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:13:26 2022] GET /compute/v2.1/os-volumes/bba194b1-04a2-41c8-b7ad-a1215d100e0e => generated 350 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:13:27.062157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b445280d-b6b3-4852-b7fb-c53521698413 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:27.064304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b445280d-b6b3-4852-b7fb-c53521698413 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:27.273927 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b445280d-b6b3-4852-b7fb-c53521698413 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:27.306059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b445280d-b6b3-4852-b7fb-c53521698413 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1214 microversion: 2.1 time: 0.273143 Apr 05 11:13:27.316437 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 3/10] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:27 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1214 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:27.798181 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-16f70615-1770-442b-8186-1389f95a24a8 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] Calling method '.version_select at 0x7fec0d5c8550>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:27.882659 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-16f70615-1770-442b-8186-1389f95a24a8 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] HTTP exception thrown: Volume 8afd8cc5-b6d4-4116-a388-8b8dfc497c00 could not be found. Apr 05 11:13:27.883430 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-16f70615-1770-442b-8186-1389f95a24a8 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] Returning 404 to user: Volume 8afd8cc5-b6d4-4116-a388-8b8dfc497c00 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:13:27.887042 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-16f70615-1770-442b-8186-1389f95a24a8 tempest-VolumesGetTestJSON-43754788 tempest-VolumesGetTestJSON-43754788-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8afd8cc5-b6d4-4116-a388-8b8dfc497c00" status: 404 len: 109 microversion: 2.1 time: 0.090560 Apr 05 11:13:27.889531 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 8/11] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:13:27 2022] GET /compute/v2.1/os-volumes/8afd8cc5-b6d4-4116-a388-8b8dfc497c00 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:13:28.329251 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-677c2c8f-016e-4c28-a736-79b5dc4cacd2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:28.329779 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-677c2c8f-016e-4c28-a736-79b5dc4cacd2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:28.499632 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-677c2c8f-016e-4c28-a736-79b5dc4cacd2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:28.507403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-677c2c8f-016e-4c28-a736-79b5dc4cacd2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1214 microversion: 2.1 time: 0.183837 Apr 05 11:13:28.511468 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 4/12] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:28 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1214 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:29.528553 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-15dd2008-07db-4a63-948e-3404470feb19 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:29.530510 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-15dd2008-07db-4a63-948e-3404470feb19 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:29.700805 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-15dd2008-07db-4a63-948e-3404470feb19 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:29.724534 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-15dd2008-07db-4a63-948e-3404470feb19 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1214 microversion: 2.1 time: 0.200801 Apr 05 11:13:29.725556 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 9/13] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:29 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:30.341772 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d14305db-6b08-4ba5-bc1b-dac41769a18f tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] Calling method '.version_select at 0x7fec0c432af0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:30.437188 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d14305db-6b08-4ba5-bc1b-dac41769a18f tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/9e8bf415-d6d6-48b0-99bf-ba2a2cc297b7" status: 200 len: 349 microversion: 2.1 time: 0.102780 Apr 05 11:13:30.438129 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 5/14] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:13:30 2022] GET /compute/v2.1/os-volumes/9e8bf415-d6d6-48b0-99bf-ba2a2cc297b7 => generated 349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:13:30.449905 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cc531d6a-56d5-4253-b75b-1799d7a5c526 tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] Calling method '.version_select at 0x7fec0d6ee310>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:30.728598 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cc531d6a-56d5-4253-b75b-1799d7a5c526 tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.282676 Apr 05 11:13:30.729937 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 10/15] 10.222.0.39 () {58 vars in 1133 bytes} [Tue Apr 5 11:13:30 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:13:30.749101 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e0fd9b9d-08af-439e-a099-9fd8a063d22d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:30.751246 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e0fd9b9d-08af-439e-a099-9fd8a063d22d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:30.753138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c75e924d-f41a-4054-b049-d50b95da6881 tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] Calling method '.version_select at 0x7fec0c4440d0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:30.785641 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0fd9b9d-08af-439e-a099-9fd8a063d22d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:30.789568 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0fd9b9d-08af-439e-a099-9fd8a063d22d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:30.804217 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0fd9b9d-08af-439e-a099-9fd8a063d22d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:30.804673 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0fd9b9d-08af-439e-a099-9fd8a063d22d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:31.039015 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c75e924d-f41a-4054-b049-d50b95da6881 tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.300375 Apr 05 11:13:31.040408 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 6/16] 10.222.0.39 () {58 vars in 1148 bytes} [Tue Apr 5 11:13:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:13:31.052830 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a2230131-c2f0-4851-ac56-58aa5ec840bc tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] Calling method '.version_select at 0x7fec0c432a60>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:31.247796 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e0fd9b9d-08af-439e-a099-9fd8a063d22d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:31.282261 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e0fd9b9d-08af-439e-a099-9fd8a063d22d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1210 microversion: 2.1 time: 0.538140 Apr 05 11:13:31.294253 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 11/17] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:30 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1210 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:13:31.316082 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a2230131-c2f0-4851-ac56-58aa5ec840bc tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.267773 Apr 05 11:13:31.316869 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 7/18] 10.222.0.39 () {58 vars in 1133 bytes} [Tue Apr 5 11:13:31 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:13:31.331468 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3eae5c07-bb34-4ab5-a0d7-85004b013e22 tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] Calling method '.version_select at 0x7fec0d510670>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:31.635614 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3eae5c07-bb34-4ab5-a0d7-85004b013e22 tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.307157 Apr 05 11:13:31.636308 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 12/19] 10.222.0.39 () {58 vars in 1166 bytes} [Tue Apr 5 11:13:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:13:31.649059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9c2e0d26-111a-40db-a72a-2dd1a6b20e8d tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] Calling method '.version_select at 0x7fec0c410dc0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:31.807725 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9c2e0d26-111a-40db-a72a-2dd1a6b20e8d tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.162624 Apr 05 11:13:31.808901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 8/20] 10.222.0.39 () {58 vars in 1169 bytes} [Tue Apr 5 11:13:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:13:31.824368 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-25a336ec-5da7-4722-914f-0a28b873deeb tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] Calling method '.version_select at 0x7fec0d4984c0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:32.002219 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-25a336ec-5da7-4722-914f-0a28b873deeb tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.184182 Apr 05 11:13:32.003138 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 13/21] 10.222.0.39 () {58 vars in 1154 bytes} [Tue Apr 5 11:13:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:32.015186 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0ce832ab-b419-4c4a-896f-2a05a2a9fb3d tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] Calling method '.version_select at 0x7fec0c444ee0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:32.227298 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0ce832ab-b419-4c4a-896f-2a05a2a9fb3d tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.216847 Apr 05 11:13:32.236229 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 9/22] 10.222.0.39 () {58 vars in 1187 bytes} [Tue Apr 5 11:13:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:13:32.240597 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c1996d59-6ebe-4439-8e96-8d31f5a41381 tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] Calling method '.version_select at 0x7fec0d510c10>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:32.311531 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-50f4d6b4-0070-4d1a-9939-70bf9d727cd4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:32.312385 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-50f4d6b4-0070-4d1a-9939-70bf9d727cd4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:32.324979 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-50f4d6b4-0070-4d1a-9939-70bf9d727cd4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:32.328735 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-50f4d6b4-0070-4d1a-9939-70bf9d727cd4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:32.329588 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-50f4d6b4-0070-4d1a-9939-70bf9d727cd4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:32.330039 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-50f4d6b4-0070-4d1a-9939-70bf9d727cd4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:32.452608 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c1996d59-6ebe-4439-8e96-8d31f5a41381 tempest-VolumesTestJSON-1460624023 tempest-VolumesTestJSON-1460624023-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.216055 Apr 05 11:13:32.453773 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 14/23] 10.222.0.39 () {58 vars in 1154 bytes} [Tue Apr 5 11:13:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:13:32.839368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-50f4d6b4-0070-4d1a-9939-70bf9d727cd4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:32.879276 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-50f4d6b4-0070-4d1a-9939-70bf9d727cd4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1210 microversion: 2.1 time: 0.566561 Apr 05 11:13:32.883040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 10/24] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:32 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1210 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:13:33.615992 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-90f7e78c-2450-4d6b-9cc5-e06c751c8677 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Action: 'create', calling method: .version_select at 0x7fec0d498550>, body: {"keypair": {"name": "tempest-keypair-1826705979"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:13:33.730547 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-90f7e78c-2450-4d6b-9cc5-e06c751c8677 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Getting quotas for project ee45cad25b8c4845b2cf9c11ab2dd7c8. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:13:33.751740 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-90f7e78c-2450-4d6b-9cc5-e06c751c8677 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Getting quotas for user 80261d844de047b18aa2ae70dbc3a4ec and project ee45cad25b8c4845b2cf9c11ab2dd7c8. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:13:33.898101 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-72cf5939-813c-472f-aac7-1a46bfb7b94b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:33.899461 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-72cf5939-813c-472f-aac7-1a46bfb7b94b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:33.915783 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72cf5939-813c-472f-aac7-1a46bfb7b94b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:33.916543 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72cf5939-813c-472f-aac7-1a46bfb7b94b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:33.917880 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72cf5939-813c-472f-aac7-1a46bfb7b94b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:33.918912 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72cf5939-813c-472f-aac7-1a46bfb7b94b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:34.122381 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-72cf5939-813c-472f-aac7-1a46bfb7b94b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:34.131828 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-72cf5939-813c-472f-aac7-1a46bfb7b94b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1210 microversion: 2.1 time: 0.238890 Apr 05 11:13:34.133404 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 11/25] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:33 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1210 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:34.528750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-90f7e78c-2450-4d6b-9cc5-e06c751c8677 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Getting quotas for project ee45cad25b8c4845b2cf9c11ab2dd7c8. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:13:34.554637 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-90f7e78c-2450-4d6b-9cc5-e06c751c8677 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Getting quotas for user 80261d844de047b18aa2ae70dbc3a4ec and project ee45cad25b8c4845b2cf9c11ab2dd7c8. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:13:34.603330 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-90f7e78c-2450-4d6b-9cc5-e06c751c8677 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.351085 Apr 05 11:13:34.610547 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 15/26] 10.222.0.39 () {62 vars in 1198 bytes} [Tue Apr 5 11:13:33 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1359 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 05 11:13:35.150064 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-10e40783-d3f4-4a61-b0d6-123011a36681 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:35.151264 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-10e40783-d3f4-4a61-b0d6-123011a36681 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:35.162565 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10e40783-d3f4-4a61-b0d6-123011a36681 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:35.173661 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10e40783-d3f4-4a61-b0d6-123011a36681 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:35.173661 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10e40783-d3f4-4a61-b0d6-123011a36681 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:35.173661 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10e40783-d3f4-4a61-b0d6-123011a36681 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:35.289916 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-10e40783-d3f4-4a61-b0d6-123011a36681 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:35.301759 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-10e40783-d3f4-4a61-b0d6-123011a36681 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1266 microversion: 2.1 time: 0.156126 Apr 05 11:13:35.302357 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 12/27] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:35 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:35.616145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-542a3ae6-67e9-49aa-a036-aa7a50e92094 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Action: 'create', calling method: .version_select at 0x7fec0d42f160>, body: {"keypair": {"name": "tempest-keypair-614454025"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:13:35.640004 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-542a3ae6-67e9-49aa-a036-aa7a50e92094 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Getting quotas for project e6061eea75194ee5b5efeed2e6073d75. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:13:35.645768 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-542a3ae6-67e9-49aa-a036-aa7a50e92094 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Getting quotas for user b5466bcb6971420bb3a765a38bb008a5 and project e6061eea75194ee5b5efeed2e6073d75. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:13:36.112790 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-542a3ae6-67e9-49aa-a036-aa7a50e92094 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Getting quotas for project e6061eea75194ee5b5efeed2e6073d75. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:13:36.129127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-542a3ae6-67e9-49aa-a036-aa7a50e92094 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Getting quotas for user b5466bcb6971420bb3a765a38bb008a5 and project e6061eea75194ee5b5efeed2e6073d75. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:13:36.188559 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-542a3ae6-67e9-49aa-a036-aa7a50e92094 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.867646 Apr 05 11:13:36.189523 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 16/28] 10.222.0.39 () {60 vars in 1157 bytes} [Tue Apr 5 11:13:35 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:36.320750 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-291d4856-0190-4597-a5c3-b8360541fce2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:36.322541 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-291d4856-0190-4597-a5c3-b8360541fce2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:36.330686 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-291d4856-0190-4597-a5c3-b8360541fce2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:36.341908 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-291d4856-0190-4597-a5c3-b8360541fce2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:36.343201 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-291d4856-0190-4597-a5c3-b8360541fce2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:36.343791 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-291d4856-0190-4597-a5c3-b8360541fce2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:36.553604 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-291d4856-0190-4597-a5c3-b8360541fce2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:36.577775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-291d4856-0190-4597-a5c3-b8360541fce2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1284 microversion: 2.1 time: 0.244494 Apr 05 11:13:36.579799 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 13/29] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:36 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:37.402549 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-62d36251-3477-45ae-83a0-816cd0ff928a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Action: 'create', calling method: .version_select at 0x7fec0d42f040>, body: {"keypair": {"name": "tempest-keypair-406291993"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:13:37.449154 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-62d36251-3477-45ae-83a0-816cd0ff928a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:13:37.457289 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-62d36251-3477-45ae-83a0-816cd0ff928a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for user 08f7e9cf075d43b39802bbdc58cd604f and project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:13:37.600312 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a46ef453-ffc7-45fb-869d-89230dd14759 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:37.600312 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a46ef453-ffc7-45fb-869d-89230dd14759 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:37.605759 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a46ef453-ffc7-45fb-869d-89230dd14759 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:37.606212 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a46ef453-ffc7-45fb-869d-89230dd14759 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:37.609977 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a46ef453-ffc7-45fb-869d-89230dd14759 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:37.610440 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a46ef453-ffc7-45fb-869d-89230dd14759 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:38.034443 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-62d36251-3477-45ae-83a0-816cd0ff928a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:13:38.048035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-62d36251-3477-45ae-83a0-816cd0ff928a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for user 08f7e9cf075d43b39802bbdc58cd604f and project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:13:38.078971 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a46ef453-ffc7-45fb-869d-89230dd14759 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:38.093413 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-62d36251-3477-45ae-83a0-816cd0ff928a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.219573 Apr 05 11:13:38.095353 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 17/30] 10.222.0.39 () {60 vars in 1157 bytes} [Tue Apr 5 11:13:36 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:38.102343 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a46ef453-ffc7-45fb-869d-89230dd14759 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1272 microversion: 2.1 time: 0.503330 Apr 05 11:13:38.106192 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 14/31] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:37 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1272 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:39.122656 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-69eab92a-0f7c-405d-bc7f-22a0aac49f68 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:39.125401 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-69eab92a-0f7c-405d-bc7f-22a0aac49f68 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:39.174242 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-69eab92a-0f7c-405d-bc7f-22a0aac49f68 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:39.179061 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-69eab92a-0f7c-405d-bc7f-22a0aac49f68 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:39.185513 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-69eab92a-0f7c-405d-bc7f-22a0aac49f68 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:39.191837 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-69eab92a-0f7c-405d-bc7f-22a0aac49f68 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:40.157206 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-69eab92a-0f7c-405d-bc7f-22a0aac49f68 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:40.167252 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-69eab92a-0f7c-405d-bc7f-22a0aac49f68 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 1.049014 Apr 05 11:13:40.173853 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 18/32] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:39 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:41.193722 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9a1af756-7bbf-4989-9eb5-73920c74841c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:41.195441 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9a1af756-7bbf-4989-9eb5-73920c74841c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:41.217568 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a1af756-7bbf-4989-9eb5-73920c74841c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:41.221283 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a1af756-7bbf-4989-9eb5-73920c74841c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:41.225490 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a1af756-7bbf-4989-9eb5-73920c74841c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:41.227824 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a1af756-7bbf-4989-9eb5-73920c74841c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:41.845278 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9a1af756-7bbf-4989-9eb5-73920c74841c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:41.864505 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9a1af756-7bbf-4989-9eb5-73920c74841c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.682096 Apr 05 11:13:41.873015 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 15/33] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:41 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:42.889773 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9c54b507-8d0a-41d3-bbef-c725b25ee1e4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:42.891288 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9c54b507-8d0a-41d3-bbef-c725b25ee1e4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:42.903978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c54b507-8d0a-41d3-bbef-c725b25ee1e4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:42.904765 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c54b507-8d0a-41d3-bbef-c725b25ee1e4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:42.905875 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c54b507-8d0a-41d3-bbef-c725b25ee1e4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:42.906462 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c54b507-8d0a-41d3-bbef-c725b25ee1e4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:44.115760 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9c54b507-8d0a-41d3-bbef-c725b25ee1e4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:44.125318 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9c54b507-8d0a-41d3-bbef-c725b25ee1e4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 1.239572 Apr 05 11:13:44.129806 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 19/34] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:42 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:44.713668 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1060293616", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c3ad901-dee6-4adf-8761-f4e0b40921d1"}], "security_groups": [{"name": "tempest-securitygroup--1136589565"}], "key_name": "tempest-keypair-1826705979", "user_data": "}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:13:45.125617 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-dfc8d08b-8f4d-46be-8f78-7be94f2f0f39 req-a9f8e46b-c6c3-4be5-bcd2-c00ca19bb918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8a287b-66c2-4188-acdf-60a0b6322df8", "tag": "affc6f94-bfe4-441e-977e-50e2937e208e"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:13:45.165268 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-dfc8d08b-8f4d-46be-8f78-7be94f2f0f39 req-a9f8e46b-c6c3-4be5-bcd2-c00ca19bb918 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:45.165751 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-dfc8d08b-8f4d-46be-8f78-7be94f2f0f39 req-a9f8e46b-c6c3-4be5-bcd2-c00ca19bb918 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:45.271021 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] validate_networks() for [('3c3ad901-dee6-4adf-8761-f4e0b40921d1', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:13:45.273480 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-dfc8d08b-8f4d-46be-8f78-7be94f2f0f39 req-a9f8e46b-c6c3-4be5-bcd2-c00ca19bb918 service nova] Creating event network-changed:affc6f94-bfe4-441e-977e-50e2937e208e for instance 0d8a287b-66c2-4188-acdf-60a0b6322df8 on hv-cinder-81899 Apr 05 11:13:45.275256 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-dfc8d08b-8f4d-46be-8f78-7be94f2f0f39 req-a9f8e46b-c6c3-4be5-bcd2-c00ca19bb918 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 05 11:13:45.277723 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f8233193-ae07-41b1-9b86-1df99c843a72 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:45.278650 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f8233193-ae07-41b1-9b86-1df99c843a72 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:45.280277 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f8233193-ae07-41b1-9b86-1df99c843a72 None None] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:45.315597 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f8233193-ae07-41b1-9b86-1df99c843a72 None None] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:45.340535 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.compute.rpcapi [None req-f8233193-ae07-41b1-9b86-1df99c843a72 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 05 11:13:45.344806 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f8233193-ae07-41b1-9b86-1df99c843a72 None None] Releasing lock "compute-rpcapi-router" {{(pid=117594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 05 11:13:45.448415 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f8233193-ae07-41b1-9b86-1df99c843a72 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.691198 Apr 05 11:13:45.449465 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 20/35] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:13:45.473063 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a9b7a9ad-7684-44ec-92ea-8e36dd3f74f6 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:45.480074 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a9b7a9ad-7684-44ec-92ea-8e36dd3f74f6 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:45.509679 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a9b7a9ad-7684-44ec-92ea-8e36dd3f74f6 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:45.512058 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a9b7a9ad-7684-44ec-92ea-8e36dd3f74f6 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:45.514568 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a9b7a9ad-7684-44ec-92ea-8e36dd3f74f6 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:45.519209 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a9b7a9ad-7684-44ec-92ea-8e36dd3f74f6 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:46.499474 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a9b7a9ad-7684-44ec-92ea-8e36dd3f74f6 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:46.521677 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a9b7a9ad-7684-44ec-92ea-8e36dd3f74f6 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 1.065229 Apr 05 11:13:46.525222 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 21/36] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:45 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:46.544699 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-837589780", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7217652a-af97-4947-b0e2-d005c4528ce6"}], "security_groups": [{"name": "tempest-securitygroup--1516024801"}], "key_name": "tempest-keypair-614454025", "user_data": "}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:13:46.949850 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] validate_networks() for [('7217652a-af97-4947-b0e2-d005c4528ce6', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:13:48.457210 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:13:48.457852 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:13:48.458273 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:13:48.460817 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:13:48.460817 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:13:48.472911 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:48.482718 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:48.483916 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:48.484838 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:48.517691 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Getting quotas for project ee45cad25b8c4845b2cf9c11ab2dd7c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:13:48.523611 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Getting quotas for user 80261d844de047b18aa2ae70dbc3a4ec and project ee45cad25b8c4845b2cf9c11ab2dd7c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:13:48.548542 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:13:48.555831 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:13:48.773687 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fefc7631-b3f1-448d-84e0-293fe69e76ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.065778 Apr 05 11:13:48.784164 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 16/37] 10.222.0.39 () {62 vars in 1187 bytes} [Tue Apr 5 11:13:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 4077 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 05 11:13:48.811997 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d613848f-7ac0-4840-9b10-2808e4adada4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:48.821957 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d613848f-7ac0-4840-9b10-2808e4adada4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:48.842983 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d613848f-7ac0-4840-9b10-2808e4adada4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:48.843774 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d613848f-7ac0-4840-9b10-2808e4adada4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:48.844960 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d613848f-7ac0-4840-9b10-2808e4adada4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:48.847432 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d613848f-7ac0-4840-9b10-2808e4adada4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:49.337493 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:13:49.338059 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:13:49.338509 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:13:49.338984 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:13:49.339420 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:13:49.358570 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:49.359408 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:49.360791 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:49.361401 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:49.403556 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Getting quotas for project e6061eea75194ee5b5efeed2e6073d75. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:13:49.421724 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Getting quotas for user b5466bcb6971420bb3a765a38bb008a5 and project e6061eea75194ee5b5efeed2e6073d75. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:13:49.452033 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:13:49.454940 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:13:49.497375 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d613848f-7ac0-4840-9b10-2808e4adada4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:49.507717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d613848f-7ac0-4840-9b10-2808e4adada4 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.722034 Apr 05 11:13:49.519295 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 17/38] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:48 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:49.526828 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-97abfdbe-2ea0-4468-93a2-ed5a9f0ede51 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:49.534775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-97abfdbe-2ea0-4468-93a2-ed5a9f0ede51 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:49.626077 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-341b4afa-10f3-48eb-9165-f9e7d1767e93 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.096284 Apr 05 11:13:49.627226 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 22/39] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:13:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 3101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:13:49.641575 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-589717664", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61947bc0-bf95-4d84-a95a-a866833cbe78"}], "security_groups": [{"name": "tempest-securitygroup--1995033098"}], "key_name": "tempest-keypair-406291993", "user_data": "}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:13:49.664755 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-97abfdbe-2ea0-4468-93a2-ed5a9f0ede51 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:49.683834 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-97abfdbe-2ea0-4468-93a2-ed5a9f0ede51 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:49.688315 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-97abfdbe-2ea0-4468-93a2-ed5a9f0ede51 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:49.691035 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-97abfdbe-2ea0-4468-93a2-ed5a9f0ede51 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1282 microversion: 2.20 time: 0.168337 Apr 05 11:13:49.691899 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 18/40] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:13:49 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:13:49.700226 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b64179a7-2cab-41a2-8ec8-589d2b428bc9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:49.701159 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b64179a7-2cab-41a2-8ec8-589d2b428bc9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:49.859785 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b64179a7-2cab-41a2-8ec8-589d2b428bc9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:49.867848 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b64179a7-2cab-41a2-8ec8-589d2b428bc9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1236 microversion: 2.1 time: 0.173753 Apr 05 11:13:49.878366 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 19/41] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:49 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1236 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:50.293410 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] validate_networks() for [('61947bc0-bf95-4d84-a95a-a866833cbe78', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:13:50.537937 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-50eaa2b4-0c40-4da0-b89b-0fbef893fd39 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:50.537937 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-50eaa2b4-0c40-4da0-b89b-0fbef893fd39 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:50.569041 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-50eaa2b4-0c40-4da0-b89b-0fbef893fd39 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:50.569489 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-50eaa2b4-0c40-4da0-b89b-0fbef893fd39 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:50.578888 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-50eaa2b4-0c40-4da0-b89b-0fbef893fd39 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:50.580770 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-50eaa2b4-0c40-4da0-b89b-0fbef893fd39 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:50.936271 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-50eaa2b4-0c40-4da0-b89b-0fbef893fd39 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:50.946155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-50eaa2b4-0c40-4da0-b89b-0fbef893fd39 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.423993 Apr 05 11:13:50.956350 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 20/42] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:50 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:50.961593 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c9c8d80e-ad8d-4c5f-807c-7f69714f8aea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:50.962213 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c9c8d80e-ad8d-4c5f-807c-7f69714f8aea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:50.968525 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c9c8d80e-ad8d-4c5f-807c-7f69714f8aea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:50.969175 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c9c8d80e-ad8d-4c5f-807c-7f69714f8aea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:50.970148 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c9c8d80e-ad8d-4c5f-807c-7f69714f8aea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:50.970921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c9c8d80e-ad8d-4c5f-807c-7f69714f8aea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:51.070598 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c9c8d80e-ad8d-4c5f-807c-7f69714f8aea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:51.079093 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c9c8d80e-ad8d-4c5f-807c-7f69714f8aea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:51.086809 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c9c8d80e-ad8d-4c5f-807c-7f69714f8aea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:51.099102 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c9c8d80e-ad8d-4c5f-807c-7f69714f8aea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1286 microversion: 2.20 time: 0.134098 Apr 05 11:13:51.100251 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 21/43] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:13:50 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:13:51.118684 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-71f8e6bc-90bd-482c-a38b-5941c87b1ac4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:51.119347 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-71f8e6bc-90bd-482c-a38b-5941c87b1ac4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:51.258927 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-71f8e6bc-90bd-482c-a38b-5941c87b1ac4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:51.289182 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-71f8e6bc-90bd-482c-a38b-5941c87b1ac4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1236 microversion: 2.1 time: 0.181062 Apr 05 11:13:51.289182 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 22/44] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:51 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1236 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:51.550303 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:13:51.551186 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:13:51.551679 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:13:51.552715 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:13:51.553566 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:13:51.564349 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:51.565936 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:51.567320 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:51.568207 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:51.588912 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:13:51.595389 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for user 08f7e9cf075d43b39802bbdc58cd604f and project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:13:51.608405 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:13:51.611771 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:13:51.806643 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-469db626-1151-46ea-bd81-0390708f308c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.175976 Apr 05 11:13:51.808949 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 23/45] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:13:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 2181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:13:51.820987 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8dedd747-5ee9-42d8-aa13-aa1052f67e7e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:51.822445 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8dedd747-5ee9-42d8-aa13-aa1052f67e7e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:51.939372 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8dedd747-5ee9-42d8-aa13-aa1052f67e7e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:51.954571 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8dedd747-5ee9-42d8-aa13-aa1052f67e7e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1240 microversion: 2.1 time: 0.138546 Apr 05 11:13:51.964625 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fa56f603-cb4e-4bac-87be-9eca3ca03d97 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:51.965471 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fa56f603-cb4e-4bac-87be-9eca3ca03d97 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:51.967304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 23/46] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:51 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1240 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:51.975415 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fa56f603-cb4e-4bac-87be-9eca3ca03d97 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:51.975943 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fa56f603-cb4e-4bac-87be-9eca3ca03d97 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:51.976935 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fa56f603-cb4e-4bac-87be-9eca3ca03d97 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:51.977649 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fa56f603-cb4e-4bac-87be-9eca3ca03d97 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:52.133007 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-51026e92-9dff-43c6-a6c2-c1a49e8e4f95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:52.133690 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-51026e92-9dff-43c6-a6c2-c1a49e8e4f95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:52.143143 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51026e92-9dff-43c6-a6c2-c1a49e8e4f95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:52.143762 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51026e92-9dff-43c6-a6c2-c1a49e8e4f95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:52.144645 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51026e92-9dff-43c6-a6c2-c1a49e8e4f95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:52.147108 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51026e92-9dff-43c6-a6c2-c1a49e8e4f95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:52.347676 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fa56f603-cb4e-4bac-87be-9eca3ca03d97 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:52.358452 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fa56f603-cb4e-4bac-87be-9eca3ca03d97 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.396061 Apr 05 11:13:52.363273 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 24/47] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:51 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:52.367611 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-51026e92-9dff-43c6-a6c2-c1a49e8e4f95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:52.382118 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-51026e92-9dff-43c6-a6c2-c1a49e8e4f95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:52.382366 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-891fdb76-2c09-4247-b986-8a76a59b9ef1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:52.383299 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-891fdb76-2c09-4247-b986-8a76a59b9ef1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:52.386906 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-51026e92-9dff-43c6-a6c2-c1a49e8e4f95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:52.391347 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-51026e92-9dff-43c6-a6c2-c1a49e8e4f95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1334 microversion: 2.20 time: 0.265638 Apr 05 11:13:52.405656 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 24/48] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:13:52 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1334 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:13:52.412758 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-891fdb76-2c09-4247-b986-8a76a59b9ef1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:52.413227 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-891fdb76-2c09-4247-b986-8a76a59b9ef1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:52.414006 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-891fdb76-2c09-4247-b986-8a76a59b9ef1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:52.437493 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-891fdb76-2c09-4247-b986-8a76a59b9ef1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:52.535856 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-891fdb76-2c09-4247-b986-8a76a59b9ef1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:52.581782 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-891fdb76-2c09-4247-b986-8a76a59b9ef1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1232 microversion: 2.1 time: 0.217044 Apr 05 11:13:52.598797 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 25/49] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:52 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1232 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:52.986758 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6634affd-6f82-45ae-a042-0bdaa4e7baac tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:52.988165 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6634affd-6f82-45ae-a042-0bdaa4e7baac tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:53.053850 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6634affd-6f82-45ae-a042-0bdaa4e7baac tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:53.062647 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6634affd-6f82-45ae-a042-0bdaa4e7baac tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1240 microversion: 2.1 time: 0.081067 Apr 05 11:13:53.071270 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 25/50] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:52 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:53.380429 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-62d4f4c3-1688-46a2-957d-e2c6ab6c9ec5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:53.382965 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-62d4f4c3-1688-46a2-957d-e2c6ab6c9ec5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:53.391958 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-62d4f4c3-1688-46a2-957d-e2c6ab6c9ec5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:53.392690 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-62d4f4c3-1688-46a2-957d-e2c6ab6c9ec5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:53.394024 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-62d4f4c3-1688-46a2-957d-e2c6ab6c9ec5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:53.394441 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-62d4f4c3-1688-46a2-957d-e2c6ab6c9ec5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:53.415557 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3d24b8f4-2e7c-4291-be31-ae1bb3346fc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:53.417683 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3d24b8f4-2e7c-4291-be31-ae1bb3346fc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:53.428173 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3d24b8f4-2e7c-4291-be31-ae1bb3346fc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:53.428940 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3d24b8f4-2e7c-4291-be31-ae1bb3346fc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:53.432142 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3d24b8f4-2e7c-4291-be31-ae1bb3346fc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:53.433170 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3d24b8f4-2e7c-4291-be31-ae1bb3346fc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:53.555684 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3d24b8f4-2e7c-4291-be31-ae1bb3346fc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:53.566239 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3d24b8f4-2e7c-4291-be31-ae1bb3346fc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:53.568688 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3d24b8f4-2e7c-4291-be31-ae1bb3346fc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:53.570183 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3d24b8f4-2e7c-4291-be31-ae1bb3346fc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1342 microversion: 2.20 time: 0.160169 Apr 05 11:13:53.572467 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 26/51] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:13:53 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:13:53.603694 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b06eeb1e-84e0-469e-8f21-6d7fb088dad8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:53.608873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b06eeb1e-84e0-469e-8f21-6d7fb088dad8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:53.613830 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b06eeb1e-84e0-469e-8f21-6d7fb088dad8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:53.614975 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b06eeb1e-84e0-469e-8f21-6d7fb088dad8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:53.616527 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b06eeb1e-84e0-469e-8f21-6d7fb088dad8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:53.617151 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b06eeb1e-84e0-469e-8f21-6d7fb088dad8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:53.662404 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-62d4f4c3-1688-46a2-957d-e2c6ab6c9ec5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:53.672093 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-62d4f4c3-1688-46a2-957d-e2c6ab6c9ec5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.302274 Apr 05 11:13:53.673165 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 26/52] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:53 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:13:53.699920 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b06eeb1e-84e0-469e-8f21-6d7fb088dad8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:53.708193 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b06eeb1e-84e0-469e-8f21-6d7fb088dad8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1288 microversion: 2.1 time: 0.110260 Apr 05 11:13:53.708815 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 27/53] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:53 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1288 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:54.079286 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c1d6a977-4b6d-4e70-b20b-329d98c6070b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:54.079897 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c1d6a977-4b6d-4e70-b20b-329d98c6070b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:54.085586 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1d6a977-4b6d-4e70-b20b-329d98c6070b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:54.086032 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1d6a977-4b6d-4e70-b20b-329d98c6070b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:54.086824 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1d6a977-4b6d-4e70-b20b-329d98c6070b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:54.087267 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1d6a977-4b6d-4e70-b20b-329d98c6070b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:54.151432 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c1d6a977-4b6d-4e70-b20b-329d98c6070b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:54.158892 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c1d6a977-4b6d-4e70-b20b-329d98c6070b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1244 microversion: 2.1 time: 0.083396 Apr 05 11:13:54.159679 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 27/54] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:54 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:54.595263 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5e198b8a-9bb2-48a8-a6d4-c2d2a4522086 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:54.595879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5e198b8a-9bb2-48a8-a6d4-c2d2a4522086 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:54.601669 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5e198b8a-9bb2-48a8-a6d4-c2d2a4522086 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:54.602122 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5e198b8a-9bb2-48a8-a6d4-c2d2a4522086 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:54.602946 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5e198b8a-9bb2-48a8-a6d4-c2d2a4522086 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:54.603376 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5e198b8a-9bb2-48a8-a6d4-c2d2a4522086 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:54.669846 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5e198b8a-9bb2-48a8-a6d4-c2d2a4522086 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:54.678107 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5e198b8a-9bb2-48a8-a6d4-c2d2a4522086 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:54.679785 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5e198b8a-9bb2-48a8-a6d4-c2d2a4522086 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:54.680915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5e198b8a-9bb2-48a8-a6d4-c2d2a4522086 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1342 microversion: 2.20 time: 0.089545 Apr 05 11:13:54.681489 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 28/55] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:13:54 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1342 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:13:54.691457 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1d9ac107-a55f-49d0-a9c4-df1ea8198ce0 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:54.691457 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1d9ac107-a55f-49d0-a9c4-df1ea8198ce0 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:54.696613 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d9ac107-a55f-49d0-a9c4-df1ea8198ce0 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:54.697067 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d9ac107-a55f-49d0-a9c4-df1ea8198ce0 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:54.698421 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d9ac107-a55f-49d0-a9c4-df1ea8198ce0 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:54.698890 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d9ac107-a55f-49d0-a9c4-df1ea8198ce0 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:54.728342 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-64938c30-d6f6-4b37-a12a-1eb5f7ac46e6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:54.729115 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-64938c30-d6f6-4b37-a12a-1eb5f7ac46e6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:54.736832 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64938c30-d6f6-4b37-a12a-1eb5f7ac46e6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:54.737912 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64938c30-d6f6-4b37-a12a-1eb5f7ac46e6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:54.738959 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64938c30-d6f6-4b37-a12a-1eb5f7ac46e6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:54.739608 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64938c30-d6f6-4b37-a12a-1eb5f7ac46e6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:54.836229 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-64938c30-d6f6-4b37-a12a-1eb5f7ac46e6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:54.847602 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-64938c30-d6f6-4b37-a12a-1eb5f7ac46e6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1288 microversion: 2.1 time: 0.125193 Apr 05 11:13:54.857717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 29/56] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:54 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1288 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:54.894403 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1d9ac107-a55f-49d0-a9c4-df1ea8198ce0 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:54.902993 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1d9ac107-a55f-49d0-a9c4-df1ea8198ce0 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.216548 Apr 05 11:13:54.902993 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 28/57] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:54 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:13:55.186406 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-696b22c5-f909-486f-85e1-cd0fba05d869 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:55.187062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-696b22c5-f909-486f-85e1-cd0fba05d869 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:55.193461 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-696b22c5-f909-486f-85e1-cd0fba05d869 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:55.193896 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-696b22c5-f909-486f-85e1-cd0fba05d869 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:55.194681 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-696b22c5-f909-486f-85e1-cd0fba05d869 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:55.195158 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-696b22c5-f909-486f-85e1-cd0fba05d869 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:55.285731 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-696b22c5-f909-486f-85e1-cd0fba05d869 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:55.294822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-696b22c5-f909-486f-85e1-cd0fba05d869 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1244 microversion: 2.1 time: 0.112997 Apr 05 11:13:55.295662 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 30/58] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:55 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1244 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:55.699836 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c9594555-6eea-4b1b-ba6c-ad231bd38b0a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:55.700627 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c9594555-6eea-4b1b-ba6c-ad231bd38b0a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:55.707071 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9594555-6eea-4b1b-ba6c-ad231bd38b0a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:55.707071 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9594555-6eea-4b1b-ba6c-ad231bd38b0a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:55.708054 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9594555-6eea-4b1b-ba6c-ad231bd38b0a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:55.708486 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9594555-6eea-4b1b-ba6c-ad231bd38b0a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:55.770332 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c9594555-6eea-4b1b-ba6c-ad231bd38b0a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:55.778981 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c9594555-6eea-4b1b-ba6c-ad231bd38b0a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:55.780773 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c9594555-6eea-4b1b-ba6c-ad231bd38b0a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:55.782072 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c9594555-6eea-4b1b-ba6c-ad231bd38b0a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1342 microversion: 2.20 time: 0.086983 Apr 05 11:13:55.782670 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 29/59] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:13:55 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1342 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:13:55.878040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5c0061b0-e633-4f90-947a-84d41950edb8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:55.878697 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5c0061b0-e633-4f90-947a-84d41950edb8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:55.885308 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c0061b0-e633-4f90-947a-84d41950edb8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:55.886059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c0061b0-e633-4f90-947a-84d41950edb8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:55.886863 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c0061b0-e633-4f90-947a-84d41950edb8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:55.887345 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c0061b0-e633-4f90-947a-84d41950edb8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:55.919586 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9c2d8939-976c-4cc2-9adc-b0b9dbe24edc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:55.920270 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9c2d8939-976c-4cc2-9adc-b0b9dbe24edc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:55.926418 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c2d8939-976c-4cc2-9adc-b0b9dbe24edc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:55.926916 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c2d8939-976c-4cc2-9adc-b0b9dbe24edc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:55.928088 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c2d8939-976c-4cc2-9adc-b0b9dbe24edc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:55.928746 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c2d8939-976c-4cc2-9adc-b0b9dbe24edc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:55.959476 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5c0061b0-e633-4f90-947a-84d41950edb8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:55.967531 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5c0061b0-e633-4f90-947a-84d41950edb8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1288 microversion: 2.1 time: 0.105985 Apr 05 11:13:55.969140 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 31/60] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:55 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:56.082284 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9c2d8939-976c-4cc2-9adc-b0b9dbe24edc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:56.084976 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9c2d8939-976c-4cc2-9adc-b0b9dbe24edc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.170074 Apr 05 11:13:56.085572 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 30/61] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:55 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:13:56.311546 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-296b4c4f-e00b-4288-bb62-403d9f868e0b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:56.312153 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-296b4c4f-e00b-4288-bb62-403d9f868e0b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:56.317912 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-296b4c4f-e00b-4288-bb62-403d9f868e0b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:56.318346 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-296b4c4f-e00b-4288-bb62-403d9f868e0b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:56.319170 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-296b4c4f-e00b-4288-bb62-403d9f868e0b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:56.319590 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-296b4c4f-e00b-4288-bb62-403d9f868e0b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:56.380186 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-296b4c4f-e00b-4288-bb62-403d9f868e0b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:56.388246 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-296b4c4f-e00b-4288-bb62-403d9f868e0b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1244 microversion: 2.1 time: 0.080525 Apr 05 11:13:56.388822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 32/62] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:56 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:56.800874 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-010a9420-ae86-474a-b02b-c385094014a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:56.801447 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-010a9420-ae86-474a-b02b-c385094014a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:56.808129 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-010a9420-ae86-474a-b02b-c385094014a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:56.808576 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-010a9420-ae86-474a-b02b-c385094014a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:56.809343 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-010a9420-ae86-474a-b02b-c385094014a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:56.809774 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-010a9420-ae86-474a-b02b-c385094014a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:56.868548 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-010a9420-ae86-474a-b02b-c385094014a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:56.877723 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-010a9420-ae86-474a-b02b-c385094014a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:56.879372 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-010a9420-ae86-474a-b02b-c385094014a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:56.880515 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-010a9420-ae86-474a-b02b-c385094014a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1342 microversion: 2.20 time: 0.083874 Apr 05 11:13:56.881340 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 31/63] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:13:56 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1342 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:13:56.985402 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7c2967ea-57ac-47b1-8b4a-f54b41cbed90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:56.992181 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7c2967ea-57ac-47b1-8b4a-f54b41cbed90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:56.992472 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c2967ea-57ac-47b1-8b4a-f54b41cbed90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:56.992909 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c2967ea-57ac-47b1-8b4a-f54b41cbed90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:56.993707 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c2967ea-57ac-47b1-8b4a-f54b41cbed90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:56.994159 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c2967ea-57ac-47b1-8b4a-f54b41cbed90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:57.057846 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c2967ea-57ac-47b1-8b4a-f54b41cbed90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:57.073219 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7c2967ea-57ac-47b1-8b4a-f54b41cbed90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1288 microversion: 2.1 time: 0.085707 Apr 05 11:13:57.073219 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 33/64] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:56 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:57.102685 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fbf27b80-970c-487c-9771-dd4553d21139 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:57.106999 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fbf27b80-970c-487c-9771-dd4553d21139 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:57.110205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fbf27b80-970c-487c-9771-dd4553d21139 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:57.110747 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fbf27b80-970c-487c-9771-dd4553d21139 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:57.111583 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fbf27b80-970c-487c-9771-dd4553d21139 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:57.112084 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fbf27b80-970c-487c-9771-dd4553d21139 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:57.254174 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fbf27b80-970c-487c-9771-dd4553d21139 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:57.267124 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fbf27b80-970c-487c-9771-dd4553d21139 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.168165 Apr 05 11:13:57.267735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 32/65] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:57 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:57.405604 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9ffff893-833f-4b3e-a704-79cdcddf9293 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:57.406124 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9ffff893-833f-4b3e-a704-79cdcddf9293 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:57.412391 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9ffff893-833f-4b3e-a704-79cdcddf9293 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:57.417483 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9ffff893-833f-4b3e-a704-79cdcddf9293 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:57.417483 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9ffff893-833f-4b3e-a704-79cdcddf9293 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:57.417483 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9ffff893-833f-4b3e-a704-79cdcddf9293 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:57.478124 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9ffff893-833f-4b3e-a704-79cdcddf9293 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:57.487283 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9ffff893-833f-4b3e-a704-79cdcddf9293 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1244 microversion: 2.1 time: 0.085625 Apr 05 11:13:57.487985 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 34/66] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:57 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:57.898629 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4c4b543d-ba8c-45b2-bc9d-55544dca5f35 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:57.899467 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4c4b543d-ba8c-45b2-bc9d-55544dca5f35 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:57.906057 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c4b543d-ba8c-45b2-bc9d-55544dca5f35 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:57.906718 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c4b543d-ba8c-45b2-bc9d-55544dca5f35 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:57.908150 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c4b543d-ba8c-45b2-bc9d-55544dca5f35 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:57.908150 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c4b543d-ba8c-45b2-bc9d-55544dca5f35 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:57.969490 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4c4b543d-ba8c-45b2-bc9d-55544dca5f35 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:57.977970 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4c4b543d-ba8c-45b2-bc9d-55544dca5f35 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:57.979674 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4c4b543d-ba8c-45b2-bc9d-55544dca5f35 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:57.980913 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4c4b543d-ba8c-45b2-bc9d-55544dca5f35 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1342 microversion: 2.20 time: 0.086162 Apr 05 11:13:57.981485 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:13:57 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:13:58.087473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1eb824cc-4b5f-4301-834e-f52e8d548b33 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:58.088789 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1eb824cc-4b5f-4301-834e-f52e8d548b33 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:58.095461 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1eb824cc-4b5f-4301-834e-f52e8d548b33 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:58.095917 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1eb824cc-4b5f-4301-834e-f52e8d548b33 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:58.096708 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1eb824cc-4b5f-4301-834e-f52e8d548b33 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:58.097155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1eb824cc-4b5f-4301-834e-f52e8d548b33 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:58.183000 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1eb824cc-4b5f-4301-834e-f52e8d548b33 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:58.189980 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1eb824cc-4b5f-4301-834e-f52e8d548b33 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1288 microversion: 2.1 time: 0.106598 Apr 05 11:13:58.190567 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 35/68] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:58 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:58.290371 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2935981f-863c-4c75-8968-407d3cc760bc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:58.291782 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2935981f-863c-4c75-8968-407d3cc760bc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:58.298305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2935981f-863c-4c75-8968-407d3cc760bc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:58.298806 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2935981f-863c-4c75-8968-407d3cc760bc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:58.299669 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2935981f-863c-4c75-8968-407d3cc760bc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:58.300107 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2935981f-863c-4c75-8968-407d3cc760bc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:58.458385 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2935981f-863c-4c75-8968-407d3cc760bc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:58.467016 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2935981f-863c-4c75-8968-407d3cc760bc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.185534 Apr 05 11:13:58.467721 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 34/69] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:58 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:58.505462 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-04001b62-0f1c-49e4-b1fa-3ff6928a0de9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:58.506075 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-04001b62-0f1c-49e4-b1fa-3ff6928a0de9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:58.512421 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-04001b62-0f1c-49e4-b1fa-3ff6928a0de9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:58.512913 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-04001b62-0f1c-49e4-b1fa-3ff6928a0de9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:58.513732 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-04001b62-0f1c-49e4-b1fa-3ff6928a0de9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:58.514126 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-04001b62-0f1c-49e4-b1fa-3ff6928a0de9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:58.600608 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-04001b62-0f1c-49e4-b1fa-3ff6928a0de9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:58.608555 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-04001b62-0f1c-49e4-b1fa-3ff6928a0de9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1244 microversion: 2.1 time: 0.107220 Apr 05 11:13:58.609153 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 36/70] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:58 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1244 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:59.000352 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c62a6689-a7da-45a4-be41-eee75504de31 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:59.000873 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c62a6689-a7da-45a4-be41-eee75504de31 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:59.010100 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c62a6689-a7da-45a4-be41-eee75504de31 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:59.010750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c62a6689-a7da-45a4-be41-eee75504de31 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:59.015746 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c62a6689-a7da-45a4-be41-eee75504de31 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:59.017600 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c62a6689-a7da-45a4-be41-eee75504de31 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:59.086297 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c62a6689-a7da-45a4-be41-eee75504de31 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:59.094869 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c62a6689-a7da-45a4-be41-eee75504de31 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:59.096487 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c62a6689-a7da-45a4-be41-eee75504de31 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:59.097601 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c62a6689-a7da-45a4-be41-eee75504de31 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1342 microversion: 2.20 time: 0.101308 Apr 05 11:13:59.098205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 35/71] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:13:58 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1342 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:13:59.207607 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-cb73f15c-4e30-4df9-95ff-cc96b7c38300 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:59.208226 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-cb73f15c-4e30-4df9-95ff-cc96b7c38300 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:59.214464 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cb73f15c-4e30-4df9-95ff-cc96b7c38300 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:59.214953 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cb73f15c-4e30-4df9-95ff-cc96b7c38300 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:59.215726 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cb73f15c-4e30-4df9-95ff-cc96b7c38300 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:59.216162 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cb73f15c-4e30-4df9-95ff-cc96b7c38300 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:59.283460 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cb73f15c-4e30-4df9-95ff-cc96b7c38300 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:59.292777 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-cb73f15c-4e30-4df9-95ff-cc96b7c38300 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1288 microversion: 2.1 time: 0.089103 Apr 05 11:13:59.301155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 37/72] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:59 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:59.488630 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-90cb4429-545b-4c8c-9bb5-720345fb99b5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:59.488630 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-90cb4429-545b-4c8c-9bb5-720345fb99b5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:59.492971 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90cb4429-545b-4c8c-9bb5-720345fb99b5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:59.493513 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90cb4429-545b-4c8c-9bb5-720345fb99b5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:59.494431 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90cb4429-545b-4c8c-9bb5-720345fb99b5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:59.495042 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90cb4429-545b-4c8c-9bb5-720345fb99b5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:59.625952 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-cf9e509a-cb10-4ba9-9dc7-e4b88bd4b157 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:13:59.626872 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-cf9e509a-cb10-4ba9-9dc7-e4b88bd4b157 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:13:59.634905 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cf9e509a-cb10-4ba9-9dc7-e4b88bd4b157 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:59.635414 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cf9e509a-cb10-4ba9-9dc7-e4b88bd4b157 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:59.636336 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cf9e509a-cb10-4ba9-9dc7-e4b88bd4b157 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:13:59.636778 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cf9e509a-cb10-4ba9-9dc7-e4b88bd4b157 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:13:59.682679 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-90cb4429-545b-4c8c-9bb5-720345fb99b5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:59.688603 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-90cb4429-545b-4c8c-9bb5-720345fb99b5 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.206853 Apr 05 11:13:59.689423 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 36/73] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:59 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:13:59.717273 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cf9e509a-cb10-4ba9-9dc7-e4b88bd4b157 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:13:59.723997 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-cf9e509a-cb10-4ba9-9dc7-e4b88bd4b157 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1236 microversion: 2.1 time: 0.102237 Apr 05 11:13:59.724670 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 38/74] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:13:59 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1236 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:00.126740 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fc3bd577-b468-46e6-a299-c8e6950b7845 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:00.128474 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fc3bd577-b468-46e6-a299-c8e6950b7845 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:00.136826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fc3bd577-b468-46e6-a299-c8e6950b7845 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:00.137499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fc3bd577-b468-46e6-a299-c8e6950b7845 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:00.138982 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fc3bd577-b468-46e6-a299-c8e6950b7845 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:00.139994 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fc3bd577-b468-46e6-a299-c8e6950b7845 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:00.309918 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a1d7b716-fcb2-4399-afcf-bc71154c717b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:00.310540 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a1d7b716-fcb2-4399-afcf-bc71154c717b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:00.323854 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a1d7b716-fcb2-4399-afcf-bc71154c717b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:00.323854 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a1d7b716-fcb2-4399-afcf-bc71154c717b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:00.324122 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a1d7b716-fcb2-4399-afcf-bc71154c717b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:00.325631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a1d7b716-fcb2-4399-afcf-bc71154c717b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:00.354230 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fc3bd577-b468-46e6-a299-c8e6950b7845 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:00.366296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fc3bd577-b468-46e6-a299-c8e6950b7845 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:00.368331 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fc3bd577-b468-46e6-a299-c8e6950b7845 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:00.373451 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fc3bd577-b468-46e6-a299-c8e6950b7845 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1420 microversion: 2.20 time: 0.260393 Apr 05 11:14:00.378660 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 37/75] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:14:00 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:14:00.406747 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a1d7b716-fcb2-4399-afcf-bc71154c717b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:00.415062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a1d7b716-fcb2-4399-afcf-bc71154c717b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1296 microversion: 2.1 time: 0.109432 Apr 05 11:14:00.415670 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 39/76] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:00 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1296 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:00.707051 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0b92369c-f97c-495f-84ca-8376a43192b3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:00.714281 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0b92369c-f97c-495f-84ca-8376a43192b3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:00.714879 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0b92369c-f97c-495f-84ca-8376a43192b3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:00.715346 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0b92369c-f97c-495f-84ca-8376a43192b3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:00.716140 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0b92369c-f97c-495f-84ca-8376a43192b3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:00.716581 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0b92369c-f97c-495f-84ca-8376a43192b3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:00.742034 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7bfeb8ed-5fb9-4b46-b90d-c89ba7475308 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:00.743099 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7bfeb8ed-5fb9-4b46-b90d-c89ba7475308 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:00.749185 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7bfeb8ed-5fb9-4b46-b90d-c89ba7475308 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:00.749633 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7bfeb8ed-5fb9-4b46-b90d-c89ba7475308 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:00.750402 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7bfeb8ed-5fb9-4b46-b90d-c89ba7475308 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:00.750937 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7bfeb8ed-5fb9-4b46-b90d-c89ba7475308 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:00.829728 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7bfeb8ed-5fb9-4b46-b90d-c89ba7475308 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:00.837352 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7bfeb8ed-5fb9-4b46-b90d-c89ba7475308 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1236 microversion: 2.1 time: 0.099776 Apr 05 11:14:00.838982 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 40/77] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:00 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1236 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:00.879758 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0b92369c-f97c-495f-84ca-8376a43192b3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:00.888750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0b92369c-f97c-495f-84ca-8376a43192b3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.185610 Apr 05 11:14:00.895116 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 38/78] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:00 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:01.393153 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9575737b-a433-4133-815a-46cf107846a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:01.393836 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9575737b-a433-4133-815a-46cf107846a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:01.399981 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9575737b-a433-4133-815a-46cf107846a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:01.401221 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9575737b-a433-4133-815a-46cf107846a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:01.401995 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9575737b-a433-4133-815a-46cf107846a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:01.402424 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9575737b-a433-4133-815a-46cf107846a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:01.433523 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4a0567eb-1d8f-4b14-94f9-b5cfff8342c4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:01.434200 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4a0567eb-1d8f-4b14-94f9-b5cfff8342c4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:01.440464 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4a0567eb-1d8f-4b14-94f9-b5cfff8342c4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:01.441038 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4a0567eb-1d8f-4b14-94f9-b5cfff8342c4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:01.441915 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4a0567eb-1d8f-4b14-94f9-b5cfff8342c4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:01.442353 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4a0567eb-1d8f-4b14-94f9-b5cfff8342c4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:01.511627 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4a0567eb-1d8f-4b14-94f9-b5cfff8342c4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:01.520984 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4a0567eb-1d8f-4b14-94f9-b5cfff8342c4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1296 microversion: 2.1 time: 0.091340 Apr 05 11:14:01.521587 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 39/79] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:01 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:01.588667 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9575737b-a433-4133-815a-46cf107846a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:01.599880 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9575737b-a433-4133-815a-46cf107846a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:01.606101 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9575737b-a433-4133-815a-46cf107846a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:01.607515 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9575737b-a433-4133-815a-46cf107846a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1420 microversion: 2.20 time: 0.218655 Apr 05 11:14:01.616591 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 41/80] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:14:01 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:14:01.873178 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f46cbc7e-2c38-4e4a-846e-569cbaec0991 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:01.873178 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f46cbc7e-2c38-4e4a-846e-569cbaec0991 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:01.880476 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f46cbc7e-2c38-4e4a-846e-569cbaec0991 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:01.887607 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f46cbc7e-2c38-4e4a-846e-569cbaec0991 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:01.889425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f46cbc7e-2c38-4e4a-846e-569cbaec0991 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:01.890474 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f46cbc7e-2c38-4e4a-846e-569cbaec0991 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:01.909921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-784d22d6-0c24-4ec2-b167-5cfe9cc8909d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:01.910544 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-784d22d6-0c24-4ec2-b167-5cfe9cc8909d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:01.921844 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-784d22d6-0c24-4ec2-b167-5cfe9cc8909d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:01.924242 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-784d22d6-0c24-4ec2-b167-5cfe9cc8909d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:01.924364 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-784d22d6-0c24-4ec2-b167-5cfe9cc8909d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:01.926069 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-784d22d6-0c24-4ec2-b167-5cfe9cc8909d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:02.024115 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f46cbc7e-2c38-4e4a-846e-569cbaec0991 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:02.036010 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f46cbc7e-2c38-4e4a-846e-569cbaec0991 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1236 microversion: 2.1 time: 0.182268 Apr 05 11:14:02.038683 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 40/81] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:01 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1236 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:02.269456 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-784d22d6-0c24-4ec2-b167-5cfe9cc8909d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:02.280778 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-784d22d6-0c24-4ec2-b167-5cfe9cc8909d tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.375036 Apr 05 11:14:02.281985 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 42/82] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:01 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:02.537862 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ae6452fa-d650-4415-91f9-693914b1b346 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:02.538504 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ae6452fa-d650-4415-91f9-693914b1b346 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:02.553152 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae6452fa-d650-4415-91f9-693914b1b346 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:02.553608 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae6452fa-d650-4415-91f9-693914b1b346 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:02.555133 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae6452fa-d650-4415-91f9-693914b1b346 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:02.555133 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae6452fa-d650-4415-91f9-693914b1b346 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:02.630164 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-db3d5053-7858-449d-a8ce-20821a84b172 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:02.630164 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-db3d5053-7858-449d-a8ce-20821a84b172 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:02.637176 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db3d5053-7858-449d-a8ce-20821a84b172 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:02.638252 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db3d5053-7858-449d-a8ce-20821a84b172 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:02.641265 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db3d5053-7858-449d-a8ce-20821a84b172 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:02.641869 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db3d5053-7858-449d-a8ce-20821a84b172 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:02.693708 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ae6452fa-d650-4415-91f9-693914b1b346 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:02.701923 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ae6452fa-d650-4415-91f9-693914b1b346 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1294 microversion: 2.1 time: 0.167968 Apr 05 11:14:02.712739 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 41/83] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:02 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1294 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:02.817499 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db3d5053-7858-449d-a8ce-20821a84b172 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:02.840332 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db3d5053-7858-449d-a8ce-20821a84b172 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:02.841984 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db3d5053-7858-449d-a8ce-20821a84b172 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:02.843504 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-db3d5053-7858-449d-a8ce-20821a84b172 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1408 microversion: 2.20 time: 0.221920 Apr 05 11:14:02.887085 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 43/84] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:14:02 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:14:02.952898 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-8e19b541-a2a7-4682-a37e-bf44c4e866f2 req-ac396ef6-a534-4c64-af1e-ca624ca68895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c900362d-904b-4d64-a9a3-ab381ca756e3", "tag": "be14224c-0258-4dc2-9ce4-f41347c20fc0"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:14:02.980906 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-8e19b541-a2a7-4682-a37e-bf44c4e866f2 req-ac396ef6-a534-4c64-af1e-ca624ca68895 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:02.982859 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-8e19b541-a2a7-4682-a37e-bf44c4e866f2 req-ac396ef6-a534-4c64-af1e-ca624ca68895 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:03.018469 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-8e19b541-a2a7-4682-a37e-bf44c4e866f2 req-ac396ef6-a534-4c64-af1e-ca624ca68895 service nova] Creating event network-changed:be14224c-0258-4dc2-9ce4-f41347c20fc0 for instance c900362d-904b-4d64-a9a3-ab381ca756e3 on hv-cinder-81899 Apr 05 11:14:03.024198 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-8e19b541-a2a7-4682-a37e-bf44c4e866f2 req-ac396ef6-a534-4c64-af1e-ca624ca68895 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076646 Apr 05 11:14:03.025033 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 42/85] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:14:03.054882 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5b54183a-67c6-4886-8960-3038d7b9ab81 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:03.056030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5b54183a-67c6-4886-8960-3038d7b9ab81 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:03.072269 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5b54183a-67c6-4886-8960-3038d7b9ab81 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:03.078331 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5b54183a-67c6-4886-8960-3038d7b9ab81 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:03.079540 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5b54183a-67c6-4886-8960-3038d7b9ab81 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:03.081285 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5b54183a-67c6-4886-8960-3038d7b9ab81 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:03.301962 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8d4938ae-ae47-46be-a4e6-20dabcf8ca2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:03.303160 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8d4938ae-ae47-46be-a4e6-20dabcf8ca2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:03.310640 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d4938ae-ae47-46be-a4e6-20dabcf8ca2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:03.317789 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d4938ae-ae47-46be-a4e6-20dabcf8ca2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:03.321167 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d4938ae-ae47-46be-a4e6-20dabcf8ca2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:03.321714 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d4938ae-ae47-46be-a4e6-20dabcf8ca2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:03.637276 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5b54183a-67c6-4886-8960-3038d7b9ab81 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:03.654633 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5b54183a-67c6-4886-8960-3038d7b9ab81 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1300 microversion: 2.1 time: 0.605005 Apr 05 11:14:03.657296 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 44/86] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:03 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1300 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:03.726696 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-efa5da1d-268c-4154-b48e-d68729550395 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:03.727455 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-efa5da1d-268c-4154-b48e-d68729550395 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:03.736700 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-efa5da1d-268c-4154-b48e-d68729550395 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:03.737449 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-efa5da1d-268c-4154-b48e-d68729550395 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:03.738387 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-efa5da1d-268c-4154-b48e-d68729550395 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:03.739075 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-efa5da1d-268c-4154-b48e-d68729550395 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:03.991896 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-efa5da1d-268c-4154-b48e-d68729550395 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:04.014222 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-efa5da1d-268c-4154-b48e-d68729550395 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1362 microversion: 2.1 time: 0.294432 Apr 05 11:14:04.017536 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 45/87] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:03 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:04.038100 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-cecc6b5b-4f40-43b9-babb-0b158d758971 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:04.041367 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-cecc6b5b-4f40-43b9-babb-0b158d758971 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:04.065360 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8d4938ae-ae47-46be-a4e6-20dabcf8ca2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:04.066500 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cecc6b5b-4f40-43b9-babb-0b158d758971 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:04.067001 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cecc6b5b-4f40-43b9-babb-0b158d758971 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:04.073449 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8d4938ae-ae47-46be-a4e6-20dabcf8ca2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.777366 Apr 05 11:14:04.075851 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cecc6b5b-4f40-43b9-babb-0b158d758971 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:04.076512 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cecc6b5b-4f40-43b9-babb-0b158d758971 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:04.078952 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 43/88] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:03 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:04.484155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cecc6b5b-4f40-43b9-babb-0b158d758971 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:04.502886 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cecc6b5b-4f40-43b9-babb-0b158d758971 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:04.505947 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cecc6b5b-4f40-43b9-babb-0b158d758971 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:04.507604 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-cecc6b5b-4f40-43b9-babb-0b158d758971 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1408 microversion: 2.20 time: 0.487777 Apr 05 11:14:04.508384 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 46/89] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:14:04 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1408 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:14:04.674004 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cffec987-e0dd-467b-a8a0-eca1d34e52c1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:04.674997 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cffec987-e0dd-467b-a8a0-eca1d34e52c1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:04.680869 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cffec987-e0dd-467b-a8a0-eca1d34e52c1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:04.682099 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cffec987-e0dd-467b-a8a0-eca1d34e52c1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:04.688448 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cffec987-e0dd-467b-a8a0-eca1d34e52c1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:04.688448 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cffec987-e0dd-467b-a8a0-eca1d34e52c1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:04.786358 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cffec987-e0dd-467b-a8a0-eca1d34e52c1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:04.794862 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cffec987-e0dd-467b-a8a0-eca1d34e52c1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1298 microversion: 2.1 time: 0.125102 Apr 05 11:14:04.795523 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 44/90] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:04 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1298 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:05.035305 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a2b02a12-b943-4dcb-9b31-ffeff19b6b8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:05.036460 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a2b02a12-b943-4dcb-9b31-ffeff19b6b8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:05.045936 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2b02a12-b943-4dcb-9b31-ffeff19b6b8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:05.046731 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2b02a12-b943-4dcb-9b31-ffeff19b6b8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:05.048541 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2b02a12-b943-4dcb-9b31-ffeff19b6b8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:05.049240 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2b02a12-b943-4dcb-9b31-ffeff19b6b8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:05.095402 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-35832f84-c982-44ea-baac-7fec4c4b94af tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:05.096028 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-35832f84-c982-44ea-baac-7fec4c4b94af tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:05.109735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-35832f84-c982-44ea-baac-7fec4c4b94af tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:05.110189 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-35832f84-c982-44ea-baac-7fec4c4b94af tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:05.111011 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-35832f84-c982-44ea-baac-7fec4c4b94af tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:05.111454 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-35832f84-c982-44ea-baac-7fec4c4b94af tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:05.411279 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a2b02a12-b943-4dcb-9b31-ffeff19b6b8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:05.427809 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a2b02a12-b943-4dcb-9b31-ffeff19b6b8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1362 microversion: 2.1 time: 0.393749 Apr 05 11:14:05.428478 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 47/91] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:05 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:05.530877 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-255cdaab-0bcc-42fd-afef-92f53e060005 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:05.531487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-255cdaab-0bcc-42fd-afef-92f53e060005 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:05.548077 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-255cdaab-0bcc-42fd-afef-92f53e060005 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:05.548534 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-255cdaab-0bcc-42fd-afef-92f53e060005 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:05.549321 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-255cdaab-0bcc-42fd-afef-92f53e060005 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:05.549755 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-255cdaab-0bcc-42fd-afef-92f53e060005 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:05.633251 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-35832f84-c982-44ea-baac-7fec4c4b94af tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:05.642656 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-35832f84-c982-44ea-baac-7fec4c4b94af tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.551035 Apr 05 11:14:05.643265 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 45/92] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:05 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:05.814226 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d419c7b5-430b-439f-85c7-78abf22e2adf tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:05.815652 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d419c7b5-430b-439f-85c7-78abf22e2adf tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:05.824823 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d419c7b5-430b-439f-85c7-78abf22e2adf tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:05.825358 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d419c7b5-430b-439f-85c7-78abf22e2adf tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:05.826242 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d419c7b5-430b-439f-85c7-78abf22e2adf tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:05.829093 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-255cdaab-0bcc-42fd-afef-92f53e060005 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:05.833771 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d419c7b5-430b-439f-85c7-78abf22e2adf tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:05.839234 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-255cdaab-0bcc-42fd-afef-92f53e060005 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:05.840779 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-255cdaab-0bcc-42fd-afef-92f53e060005 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:05.842295 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-255cdaab-0bcc-42fd-afef-92f53e060005 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1408 microversion: 2.20 time: 0.319364 Apr 05 11:14:05.844105 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 48/93] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:14:05 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:14:06.130006 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d419c7b5-430b-439f-85c7-78abf22e2adf tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:06.137795 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d419c7b5-430b-439f-85c7-78abf22e2adf tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.329503 Apr 05 11:14:06.138661 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 46/94] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:05 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:06.445188 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3eb80cbe-b574-4d1e-951c-f4eda35a8afb tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:06.448922 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3eb80cbe-b574-4d1e-951c-f4eda35a8afb tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:06.452480 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3eb80cbe-b574-4d1e-951c-f4eda35a8afb tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:06.452928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3eb80cbe-b574-4d1e-951c-f4eda35a8afb tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:06.453697 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3eb80cbe-b574-4d1e-951c-f4eda35a8afb tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:06.454134 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3eb80cbe-b574-4d1e-951c-f4eda35a8afb tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:06.591901 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3eb80cbe-b574-4d1e-951c-f4eda35a8afb tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:06.599262 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3eb80cbe-b574-4d1e-951c-f4eda35a8afb tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1362 microversion: 2.1 time: 0.157885 Apr 05 11:14:06.599846 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 47/95] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:06 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:06.660387 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5648c15e-e441-4ac0-997a-ce968731f725 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:06.660997 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5648c15e-e441-4ac0-997a-ce968731f725 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:06.667544 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5648c15e-e441-4ac0-997a-ce968731f725 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:06.668130 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5648c15e-e441-4ac0-997a-ce968731f725 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:06.668981 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5648c15e-e441-4ac0-997a-ce968731f725 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:06.669419 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5648c15e-e441-4ac0-997a-ce968731f725 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:06.810031 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5648c15e-e441-4ac0-997a-ce968731f725 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:06.817691 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5648c15e-e441-4ac0-997a-ce968731f725 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.161252 Apr 05 11:14:06.818395 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 48/96] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:06 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:06.859751 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1171b368-f016-4e3b-8537-024b82e4c309 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:06.860352 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1171b368-f016-4e3b-8537-024b82e4c309 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:06.866277 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1171b368-f016-4e3b-8537-024b82e4c309 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:06.866788 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1171b368-f016-4e3b-8537-024b82e4c309 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:06.867557 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1171b368-f016-4e3b-8537-024b82e4c309 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:06.867989 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1171b368-f016-4e3b-8537-024b82e4c309 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:07.010550 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1171b368-f016-4e3b-8537-024b82e4c309 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:07.019325 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1171b368-f016-4e3b-8537-024b82e4c309 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:07.021033 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1171b368-f016-4e3b-8537-024b82e4c309 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:07.022193 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1171b368-f016-4e3b-8537-024b82e4c309 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1408 microversion: 2.20 time: 0.166698 Apr 05 11:14:07.023119 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 49/97] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:14:06 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:14:07.083151 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-20dd72b4-605c-4682-9e14-34b494ebffdc req-c494ef31-bf8a-48ed-95a4-c7194138ef5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8a287b-66c2-4188-acdf-60a0b6322df8", "name": "network-vif-plugged", "status": "completed", "tag": "affc6f94-bfe4-441e-977e-50e2937e208e"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:14:07.100424 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-20dd72b4-605c-4682-9e14-34b494ebffdc req-c494ef31-bf8a-48ed-95a4-c7194138ef5c service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:07.101591 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-20dd72b4-605c-4682-9e14-34b494ebffdc req-c494ef31-bf8a-48ed-95a4-c7194138ef5c service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:07.125536 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-20dd72b4-605c-4682-9e14-34b494ebffdc req-c494ef31-bf8a-48ed-95a4-c7194138ef5c service nova] Creating event network-vif-plugged:affc6f94-bfe4-441e-977e-50e2937e208e for instance 0d8a287b-66c2-4188-acdf-60a0b6322df8 on hv-cinder-81899 Apr 05 11:14:07.126565 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-20dd72b4-605c-4682-9e14-34b494ebffdc req-c494ef31-bf8a-48ed-95a4-c7194138ef5c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 05 11:14:07.127844 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db800469-ebac-443f-8de0-f07dd80411cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:07.128606 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db800469-ebac-443f-8de0-f07dd80411cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:07.129612 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db800469-ebac-443f-8de0-f07dd80411cf None None] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:07.130232 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db800469-ebac-443f-8de0-f07dd80411cf None None] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:07.142386 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.compute.rpcapi [None req-db800469-ebac-443f-8de0-f07dd80411cf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 05 11:14:07.143679 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db800469-ebac-443f-8de0-f07dd80411cf None None] Releasing lock "compute-rpcapi-router" {{(pid=117593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 05 11:14:07.169590 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-db800469-ebac-443f-8de0-f07dd80411cf None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.102074 Apr 05 11:14:07.170904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 49/98] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:14:07.177913 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-289a5ed8-f748-4bfa-8a20-909cad327162 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:07.178950 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-289a5ed8-f748-4bfa-8a20-909cad327162 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:07.203403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-289a5ed8-f748-4bfa-8a20-909cad327162 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:07.204950 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-289a5ed8-f748-4bfa-8a20-909cad327162 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:07.205840 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-289a5ed8-f748-4bfa-8a20-909cad327162 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:07.206339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-289a5ed8-f748-4bfa-8a20-909cad327162 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:07.391893 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-b77bb7a3-1ec9-4b51-b546-0ce523e5efaa req-30b02a57-b076-4521-b50e-a26795e6f77f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a98ab2b1-5651-42f4-b1f3-de4469d542ad", "tag": "dc7aebba-05fe-428c-9500-aeca3f7e1c99"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:14:07.422302 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-b77bb7a3-1ec9-4b51-b546-0ce523e5efaa req-30b02a57-b076-4521-b50e-a26795e6f77f service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:07.423654 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-b77bb7a3-1ec9-4b51-b546-0ce523e5efaa req-30b02a57-b076-4521-b50e-a26795e6f77f service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:07.458220 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-b77bb7a3-1ec9-4b51-b546-0ce523e5efaa req-30b02a57-b076-4521-b50e-a26795e6f77f service nova] Creating event network-changed:dc7aebba-05fe-428c-9500-aeca3f7e1c99 for instance a98ab2b1-5651-42f4-b1f3-de4469d542ad on hv-cinder-81899 Apr 05 11:14:07.471155 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-b77bb7a3-1ec9-4b51-b546-0ce523e5efaa req-30b02a57-b076-4521-b50e-a26795e6f77f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.387182 Apr 05 11:14:07.472173 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 50/99] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:14:07.488700 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-289a5ed8-f748-4bfa-8a20-909cad327162 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:07.496785 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-289a5ed8-f748-4bfa-8a20-909cad327162 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.324354 Apr 05 11:14:07.497738 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 50/100] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:07 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:07.617456 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e54a1429-f260-4254-a668-6fcc3df9bfe6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:07.618160 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e54a1429-f260-4254-a668-6fcc3df9bfe6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:07.630511 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e54a1429-f260-4254-a668-6fcc3df9bfe6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:07.631008 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e54a1429-f260-4254-a668-6fcc3df9bfe6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:07.631803 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e54a1429-f260-4254-a668-6fcc3df9bfe6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:07.632242 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e54a1429-f260-4254-a668-6fcc3df9bfe6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:07.837133 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-70010368-6f6e-4afb-9c74-b2f92faf5c50 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:07.838478 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-70010368-6f6e-4afb-9c74-b2f92faf5c50 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:07.850199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-70010368-6f6e-4afb-9c74-b2f92faf5c50 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:07.851120 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-70010368-6f6e-4afb-9c74-b2f92faf5c50 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:07.851926 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-70010368-6f6e-4afb-9c74-b2f92faf5c50 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:07.852556 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-70010368-6f6e-4afb-9c74-b2f92faf5c50 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:08.186412 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e54a1429-f260-4254-a668-6fcc3df9bfe6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:08.194181 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e54a1429-f260-4254-a668-6fcc3df9bfe6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1362 microversion: 2.1 time: 0.581822 Apr 05 11:14:08.198277 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 51/101] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:07 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1362 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:08.207904 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5420c4d5-43fb-43d2-8b8e-744a8c605ac1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:08.211652 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5420c4d5-43fb-43d2-8b8e-744a8c605ac1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:08.226063 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5420c4d5-43fb-43d2-8b8e-744a8c605ac1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:08.226829 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5420c4d5-43fb-43d2-8b8e-744a8c605ac1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:08.236512 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5420c4d5-43fb-43d2-8b8e-744a8c605ac1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:08.236512 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5420c4d5-43fb-43d2-8b8e-744a8c605ac1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:08.322872 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-70010368-6f6e-4afb-9c74-b2f92faf5c50 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:08.330357 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-70010368-6f6e-4afb-9c74-b2f92faf5c50 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.498879 Apr 05 11:14:08.331269 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 51/102] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:07 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:08.516371 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-64021564-f0dc-45fa-ba52-a757c1bdb4b6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:08.516981 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-64021564-f0dc-45fa-ba52-a757c1bdb4b6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:08.529755 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64021564-f0dc-45fa-ba52-a757c1bdb4b6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:08.530398 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64021564-f0dc-45fa-ba52-a757c1bdb4b6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:08.531846 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64021564-f0dc-45fa-ba52-a757c1bdb4b6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:08.532477 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64021564-f0dc-45fa-ba52-a757c1bdb4b6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:08.564656 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5420c4d5-43fb-43d2-8b8e-744a8c605ac1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:08.574781 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5420c4d5-43fb-43d2-8b8e-744a8c605ac1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:08.577271 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5420c4d5-43fb-43d2-8b8e-744a8c605ac1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:08.578741 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5420c4d5-43fb-43d2-8b8e-744a8c605ac1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1408 microversion: 2.20 time: 0.379259 Apr 05 11:14:08.590318 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 52/103] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:14:08 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1408 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:14:08.723497 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-64021564-f0dc-45fa-ba52-a757c1bdb4b6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:08.733789 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-64021564-f0dc-45fa-ba52-a757c1bdb4b6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.221697 Apr 05 11:14:08.745146 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 52/104] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:08 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:09.215120 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-49fc6e99-76ca-4b86-9a9f-540b9d034437 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:09.219134 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-49fc6e99-76ca-4b86-9a9f-540b9d034437 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:09.230179 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49fc6e99-76ca-4b86-9a9f-540b9d034437 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:09.231429 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49fc6e99-76ca-4b86-9a9f-540b9d034437 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:09.232592 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49fc6e99-76ca-4b86-9a9f-540b9d034437 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:09.233284 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49fc6e99-76ca-4b86-9a9f-540b9d034437 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:09.350088 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1e535056-548d-4103-b0fb-43e2ff9cc7b9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:09.351380 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1e535056-548d-4103-b0fb-43e2ff9cc7b9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:09.361392 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1e535056-548d-4103-b0fb-43e2ff9cc7b9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:09.362152 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1e535056-548d-4103-b0fb-43e2ff9cc7b9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:09.363166 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1e535056-548d-4103-b0fb-43e2ff9cc7b9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:09.363784 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1e535056-548d-4103-b0fb-43e2ff9cc7b9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:09.470560 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-49fc6e99-76ca-4b86-9a9f-540b9d034437 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:09.479329 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-49fc6e99-76ca-4b86-9a9f-540b9d034437 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1362 microversion: 2.1 time: 0.268321 Apr 05 11:14:09.482120 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 53/105] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:09 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:09.526525 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-7578e3ec-8940-494a-a4ee-ab82c2006986 req-fa9288fd-59c1-4060-8cc9-d4d83970f6dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e206c1c-372e-45c5-bb53-11d7ba0fb01f", "tag": "f05746fb-fbaf-4f6f-a2a4-ac06ce53f6b6"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:14:09.535604 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-7578e3ec-8940-494a-a4ee-ab82c2006986 req-fa9288fd-59c1-4060-8cc9-d4d83970f6dc service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:09.536495 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-7578e3ec-8940-494a-a4ee-ab82c2006986 req-fa9288fd-59c1-4060-8cc9-d4d83970f6dc service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:09.552453 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-7578e3ec-8940-494a-a4ee-ab82c2006986 req-fa9288fd-59c1-4060-8cc9-d4d83970f6dc service nova] Creating event network-changed:f05746fb-fbaf-4f6f-a2a4-ac06ce53f6b6 for instance 8e206c1c-372e-45c5-bb53-11d7ba0fb01f on hv-cinder-81899 Apr 05 11:14:09.571218 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-7578e3ec-8940-494a-a4ee-ab82c2006986 req-fa9288fd-59c1-4060-8cc9-d4d83970f6dc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049653 Apr 05 11:14:09.573390 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 54/106] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:14:09.597971 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ee3321ee-6b2e-4446-9637-dacb33d8d4cd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:09.599012 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ee3321ee-6b2e-4446-9637-dacb33d8d4cd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:09.605860 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ee3321ee-6b2e-4446-9637-dacb33d8d4cd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:09.606409 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ee3321ee-6b2e-4446-9637-dacb33d8d4cd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:09.607932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ee3321ee-6b2e-4446-9637-dacb33d8d4cd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:09.608468 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ee3321ee-6b2e-4446-9637-dacb33d8d4cd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:09.673554 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1e535056-548d-4103-b0fb-43e2ff9cc7b9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:09.685386 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1e535056-548d-4103-b0fb-43e2ff9cc7b9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.340639 Apr 05 11:14:09.686403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 53/107] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:09 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:09.717816 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-06e6464b-a312-4760-ab3c-14658efa99cb req-8421a2b0-dd59-4aaa-a67b-11256a0dc882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c900362d-904b-4d64-a9a3-ab381ca756e3", "name": "network-vif-plugged", "status": "completed", "tag": "be14224c-0258-4dc2-9ce4-f41347c20fc0"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:14:09.726582 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-06e6464b-a312-4760-ab3c-14658efa99cb req-8421a2b0-dd59-4aaa-a67b-11256a0dc882 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:09.727045 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-06e6464b-a312-4760-ab3c-14658efa99cb req-8421a2b0-dd59-4aaa-a67b-11256a0dc882 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:09.751285 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-06e6464b-a312-4760-ab3c-14658efa99cb req-8421a2b0-dd59-4aaa-a67b-11256a0dc882 service nova] Creating event network-vif-plugged:be14224c-0258-4dc2-9ce4-f41347c20fc0 for instance c900362d-904b-4d64-a9a3-ab381ca756e3 on hv-cinder-81899 Apr 05 11:14:09.758028 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-06e6464b-a312-4760-ab3c-14658efa99cb req-8421a2b0-dd59-4aaa-a67b-11256a0dc882 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046417 Apr 05 11:14:09.759112 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 54/108] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:14:09.766104 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7460766c-6cbb-4202-be8d-0e1d8ee3a5ab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:09.766918 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7460766c-6cbb-4202-be8d-0e1d8ee3a5ab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:09.773949 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7460766c-6cbb-4202-be8d-0e1d8ee3a5ab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:09.774476 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7460766c-6cbb-4202-be8d-0e1d8ee3a5ab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:09.776039 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7460766c-6cbb-4202-be8d-0e1d8ee3a5ab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:09.776547 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7460766c-6cbb-4202-be8d-0e1d8ee3a5ab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:09.799496 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ee3321ee-6b2e-4446-9637-dacb33d8d4cd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:09.809148 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ee3321ee-6b2e-4446-9637-dacb33d8d4cd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:09.811873 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ee3321ee-6b2e-4446-9637-dacb33d8d4cd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:09.813064 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ee3321ee-6b2e-4446-9637-dacb33d8d4cd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1408 microversion: 2.20 time: 0.219907 Apr 05 11:14:09.813962 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 55/109] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:14:09 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:14:09.968628 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7460766c-6cbb-4202-be8d-0e1d8ee3a5ab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:09.976908 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7460766c-6cbb-4202-be8d-0e1d8ee3a5ab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.215863 Apr 05 11:14:09.977496 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 55/110] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:09 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:10.496046 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e55f599e-9a48-4a6e-bdaf-90986adfbcf7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:10.496703 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e55f599e-9a48-4a6e-bdaf-90986adfbcf7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:10.503040 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e55f599e-9a48-4a6e-bdaf-90986adfbcf7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:10.504525 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e55f599e-9a48-4a6e-bdaf-90986adfbcf7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:10.504525 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e55f599e-9a48-4a6e-bdaf-90986adfbcf7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:10.504740 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e55f599e-9a48-4a6e-bdaf-90986adfbcf7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:10.649050 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e55f599e-9a48-4a6e-bdaf-90986adfbcf7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:10.656577 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e55f599e-9a48-4a6e-bdaf-90986adfbcf7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1362 microversion: 2.1 time: 0.164565 Apr 05 11:14:10.657329 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 56/111] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:10 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:10.706984 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-477a1eda-5e19-4963-97fb-c13d6aa6045c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:10.707722 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-477a1eda-5e19-4963-97fb-c13d6aa6045c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:10.718407 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-477a1eda-5e19-4963-97fb-c13d6aa6045c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:10.718908 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-477a1eda-5e19-4963-97fb-c13d6aa6045c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:10.719855 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-477a1eda-5e19-4963-97fb-c13d6aa6045c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:10.720290 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-477a1eda-5e19-4963-97fb-c13d6aa6045c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:10.831621 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bde7c7bc-3b11-428c-93dd-94bfd258d47e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:10.836475 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bde7c7bc-3b11-428c-93dd-94bfd258d47e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:10.843053 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bde7c7bc-3b11-428c-93dd-94bfd258d47e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:10.843752 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bde7c7bc-3b11-428c-93dd-94bfd258d47e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:10.844694 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bde7c7bc-3b11-428c-93dd-94bfd258d47e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:10.848182 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bde7c7bc-3b11-428c-93dd-94bfd258d47e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:11.004206 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bde7c7bc-3b11-428c-93dd-94bfd258d47e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:11.012203 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bde7c7bc-3b11-428c-93dd-94bfd258d47e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:11.013726 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bde7c7bc-3b11-428c-93dd-94bfd258d47e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:11.014869 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bde7c7bc-3b11-428c-93dd-94bfd258d47e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1408 microversion: 2.20 time: 0.187051 Apr 05 11:14:11.016068 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 57/112] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:14:10 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:14:11.016193 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-477a1eda-5e19-4963-97fb-c13d6aa6045c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:11.020566 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-80d12651-bb15-4a4e-ac8e-ec3d8cbbcdab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:11.021168 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-80d12651-bb15-4a4e-ac8e-ec3d8cbbcdab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:11.023707 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-477a1eda-5e19-4963-97fb-c13d6aa6045c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.323435 Apr 05 11:14:11.024660 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 56/113] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:10 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:11.028937 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-80d12651-bb15-4a4e-ac8e-ec3d8cbbcdab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:11.029569 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-80d12651-bb15-4a4e-ac8e-ec3d8cbbcdab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:11.030546 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-80d12651-bb15-4a4e-ac8e-ec3d8cbbcdab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:11.031020 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-80d12651-bb15-4a4e-ac8e-ec3d8cbbcdab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:11.186151 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-80d12651-bb15-4a4e-ac8e-ec3d8cbbcdab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:11.194722 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-80d12651-bb15-4a4e-ac8e-ec3d8cbbcdab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.177546 Apr 05 11:14:11.195553 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 58/114] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:11 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:11.679776 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-57d86ba4-c54e-4d32-a2b7-d02aace87e7c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:11.684819 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-57d86ba4-c54e-4d32-a2b7-d02aace87e7c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:11.698690 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57d86ba4-c54e-4d32-a2b7-d02aace87e7c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:11.699259 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57d86ba4-c54e-4d32-a2b7-d02aace87e7c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:11.700089 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57d86ba4-c54e-4d32-a2b7-d02aace87e7c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:11.700532 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57d86ba4-c54e-4d32-a2b7-d02aace87e7c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:11.917380 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-57d86ba4-c54e-4d32-a2b7-d02aace87e7c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:11.924813 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-57d86ba4-c54e-4d32-a2b7-d02aace87e7c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1362 microversion: 2.1 time: 0.254232 Apr 05 11:14:11.925398 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 57/115] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:11 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:12.035175 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fe5c917e-1bf5-41d4-b346-b727a6db7792 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:12.040847 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-87aa62b7-0c8f-4cb7-b824-48c1ac3180f7 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:12.041453 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-87aa62b7-0c8f-4cb7-b824-48c1ac3180f7 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:12.044276 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fe5c917e-1bf5-41d4-b346-b727a6db7792 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:12.052518 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-87aa62b7-0c8f-4cb7-b824-48c1ac3180f7 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:12.052963 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-87aa62b7-0c8f-4cb7-b824-48c1ac3180f7 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:12.053730 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-87aa62b7-0c8f-4cb7-b824-48c1ac3180f7 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:12.054155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-87aa62b7-0c8f-4cb7-b824-48c1ac3180f7 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:12.060071 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fe5c917e-1bf5-41d4-b346-b727a6db7792 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:12.060773 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fe5c917e-1bf5-41d4-b346-b727a6db7792 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:12.061539 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fe5c917e-1bf5-41d4-b346-b727a6db7792 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:12.061970 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fe5c917e-1bf5-41d4-b346-b727a6db7792 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:12.345662 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-87aa62b7-0c8f-4cb7-b824-48c1ac3180f7 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:12.355184 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-87aa62b7-0c8f-4cb7-b824-48c1ac3180f7 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1314 microversion: 2.1 time: 0.318401 Apr 05 11:14:12.355800 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 58/116] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:12 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:12.365662 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-94bc6a92-5bf9-4913-ae7a-7b5479adeba2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:12.366400 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-94bc6a92-5bf9-4913-ae7a-7b5479adeba2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:12.373225 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-94bc6a92-5bf9-4913-ae7a-7b5479adeba2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:12.373626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-94bc6a92-5bf9-4913-ae7a-7b5479adeba2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:12.374414 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-94bc6a92-5bf9-4913-ae7a-7b5479adeba2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:12.374907 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-94bc6a92-5bf9-4913-ae7a-7b5479adeba2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:12.536215 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-94bc6a92-5bf9-4913-ae7a-7b5479adeba2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:12.544449 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-94bc6a92-5bf9-4913-ae7a-7b5479adeba2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.187600 Apr 05 11:14:12.546007 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 59/117] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:12 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:12.716500 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fe5c917e-1bf5-41d4-b346-b727a6db7792 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:12.725257 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fe5c917e-1bf5-41d4-b346-b727a6db7792 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:12.726886 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fe5c917e-1bf5-41d4-b346-b727a6db7792 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:12.728944 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fe5c917e-1bf5-41d4-b346-b727a6db7792 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1408 microversion: 2.20 time: 0.697776 Apr 05 11:14:12.729507 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 59/118] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:14:12 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1408 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:14:12.942061 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-10ea4c1a-8160-4748-91d1-a5d9a8f3c654 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:12.944458 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-10ea4c1a-8160-4748-91d1-a5d9a8f3c654 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:12.958268 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10ea4c1a-8160-4748-91d1-a5d9a8f3c654 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:12.958786 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10ea4c1a-8160-4748-91d1-a5d9a8f3c654 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:12.959584 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10ea4c1a-8160-4748-91d1-a5d9a8f3c654 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:12.960032 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10ea4c1a-8160-4748-91d1-a5d9a8f3c654 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:13.114702 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-10ea4c1a-8160-4748-91d1-a5d9a8f3c654 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:13.123134 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-10ea4c1a-8160-4748-91d1-a5d9a8f3c654 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1362 microversion: 2.1 time: 0.185179 Apr 05 11:14:13.124068 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 60/119] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:12 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:13.373865 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c6867c71-d8c8-4c92-bd78-2157f18214a2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:13.374373 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c6867c71-d8c8-4c92-bd78-2157f18214a2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:13.380900 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6867c71-d8c8-4c92-bd78-2157f18214a2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:13.381365 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6867c71-d8c8-4c92-bd78-2157f18214a2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:13.382124 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6867c71-d8c8-4c92-bd78-2157f18214a2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:13.382560 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6867c71-d8c8-4c92-bd78-2157f18214a2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:13.516355 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c6867c71-d8c8-4c92-bd78-2157f18214a2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:13.524112 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c6867c71-d8c8-4c92-bd78-2157f18214a2 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1501 microversion: 2.1 time: 0.155447 Apr 05 11:14:13.524680 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 60/120] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:13 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:13.561690 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-22e7a4b2-eb2c-4c61-b87e-7b76c416528c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:13.562291 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-22e7a4b2-eb2c-4c61-b87e-7b76c416528c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:13.568221 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-22e7a4b2-eb2c-4c61-b87e-7b76c416528c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:13.568663 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-22e7a4b2-eb2c-4c61-b87e-7b76c416528c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:13.569444 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-22e7a4b2-eb2c-4c61-b87e-7b76c416528c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:13.569873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-22e7a4b2-eb2c-4c61-b87e-7b76c416528c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:13.629010 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-a55e568e-66dd-45ae-a867-b0db542212ce req-7f833bab-4149-47dc-9f79-b5edc65537ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98ab2b1-5651-42f4-b1f3-de4469d542ad", "name": "network-vif-plugged", "status": "completed", "tag": "dc7aebba-05fe-428c-9500-aeca3f7e1c99"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:14:13.637946 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-a55e568e-66dd-45ae-a867-b0db542212ce req-7f833bab-4149-47dc-9f79-b5edc65537ff service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:13.638442 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-a55e568e-66dd-45ae-a867-b0db542212ce req-7f833bab-4149-47dc-9f79-b5edc65537ff service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:13.650875 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-a55e568e-66dd-45ae-a867-b0db542212ce req-7f833bab-4149-47dc-9f79-b5edc65537ff service nova] Creating event network-vif-plugged:dc7aebba-05fe-428c-9500-aeca3f7e1c99 for instance a98ab2b1-5651-42f4-b1f3-de4469d542ad on hv-cinder-81899 Apr 05 11:14:13.656421 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-a55e568e-66dd-45ae-a867-b0db542212ce req-7f833bab-4149-47dc-9f79-b5edc65537ff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030988 Apr 05 11:14:13.658776 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 61/121] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:14:13.710738 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-22e7a4b2-eb2c-4c61-b87e-7b76c416528c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:13.720261 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-22e7a4b2-eb2c-4c61-b87e-7b76c416528c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.162371 Apr 05 11:14:13.720831 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 61/122] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:13 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:13.747253 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-525cdc98-e31a-43f0-bd95-9eff6f4ea54f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:13.747940 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-525cdc98-e31a-43f0-bd95-9eff6f4ea54f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:13.754478 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-525cdc98-e31a-43f0-bd95-9eff6f4ea54f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:13.754945 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-525cdc98-e31a-43f0-bd95-9eff6f4ea54f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:13.755715 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-525cdc98-e31a-43f0-bd95-9eff6f4ea54f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:13.756142 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-525cdc98-e31a-43f0-bd95-9eff6f4ea54f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:14.029023 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-525cdc98-e31a-43f0-bd95-9eff6f4ea54f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:14.038312 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-525cdc98-e31a-43f0-bd95-9eff6f4ea54f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:14.040052 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-525cdc98-e31a-43f0-bd95-9eff6f4ea54f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:14.043058 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-525cdc98-e31a-43f0-bd95-9eff6f4ea54f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1408 microversion: 2.20 time: 0.299443 Apr 05 11:14:14.043058 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 62/123] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:14:13 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1408 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:14:14.140785 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1ef5b94a-e5c8-46b7-a424-609302253751 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:14.141642 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1ef5b94a-e5c8-46b7-a424-609302253751 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:14.148326 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1ef5b94a-e5c8-46b7-a424-609302253751 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:14.148971 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1ef5b94a-e5c8-46b7-a424-609302253751 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:14.149814 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1ef5b94a-e5c8-46b7-a424-609302253751 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:14.155620 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1ef5b94a-e5c8-46b7-a424-609302253751 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:14.310339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1ef5b94a-e5c8-46b7-a424-609302253751 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:14.318170 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1ef5b94a-e5c8-46b7-a424-609302253751 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1362 microversion: 2.1 time: 0.181513 Apr 05 11:14:14.318776 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 62/124] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:14 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:14.741826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-80c19eb5-cf62-4cea-953f-326f48d301d0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:14.741826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-80c19eb5-cf62-4cea-953f-326f48d301d0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:14.745927 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-80c19eb5-cf62-4cea-953f-326f48d301d0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:14.746453 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-80c19eb5-cf62-4cea-953f-326f48d301d0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:14.747378 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-80c19eb5-cf62-4cea-953f-326f48d301d0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:14.747844 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-80c19eb5-cf62-4cea-953f-326f48d301d0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:14.947762 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-80c19eb5-cf62-4cea-953f-326f48d301d0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:14.955023 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-80c19eb5-cf62-4cea-953f-326f48d301d0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.220891 Apr 05 11:14:14.955591 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 63/125] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:14 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:15.059996 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-09657adc-0bac-4558-941c-1af3dcd68725 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:15.060485 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-09657adc-0bac-4558-941c-1af3dcd68725 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:15.066740 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09657adc-0bac-4558-941c-1af3dcd68725 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:15.067347 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09657adc-0bac-4558-941c-1af3dcd68725 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:15.068256 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09657adc-0bac-4558-941c-1af3dcd68725 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:15.068796 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09657adc-0bac-4558-941c-1af3dcd68725 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:15.222811 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-09657adc-0bac-4558-941c-1af3dcd68725 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:15.231141 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-09657adc-0bac-4558-941c-1af3dcd68725 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:15.232702 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-09657adc-0bac-4558-941c-1af3dcd68725 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:15.233843 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-09657adc-0bac-4558-941c-1af3dcd68725 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1601 microversion: 2.20 time: 0.178159 Apr 05 11:14:15.234581 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 63/126] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:14:15 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1601 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:14:15.253330 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e3f9e677-ebc8-4f13-ae3a-1dc12220fb72 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:15.253836 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e3f9e677-ebc8-4f13-ae3a-1dc12220fb72 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:15.260390 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3f9e677-ebc8-4f13-ae3a-1dc12220fb72 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:15.260873 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3f9e677-ebc8-4f13-ae3a-1dc12220fb72 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:15.261647 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3f9e677-ebc8-4f13-ae3a-1dc12220fb72 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:15.262078 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3f9e677-ebc8-4f13-ae3a-1dc12220fb72 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:15.339572 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-362fea5c-c296-44d7-bb0e-d316a50d2637 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:15.340511 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-362fea5c-c296-44d7-bb0e-d316a50d2637 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:15.347501 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-362fea5c-c296-44d7-bb0e-d316a50d2637 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:15.348434 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-362fea5c-c296-44d7-bb0e-d316a50d2637 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:15.349892 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-362fea5c-c296-44d7-bb0e-d316a50d2637 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:15.350587 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-362fea5c-c296-44d7-bb0e-d316a50d2637 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:15.394462 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e3f9e677-ebc8-4f13-ae3a-1dc12220fb72 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.145316 Apr 05 11:14:15.395134 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 64/127] 10.222.0.39 () {60 vars in 1315 bytes} [Tue Apr 5 11:14:15 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:14:15.910076 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-362fea5c-c296-44d7-bb0e-d316a50d2637 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:15.921936 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-362fea5c-c296-44d7-bb0e-d316a50d2637 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1362 microversion: 2.1 time: 0.588166 Apr 05 11:14:15.932938 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 64/128] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:15 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1362 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:15.981146 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9c6b949e-9a60-4685-8b6f-b3b8e79c7b22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:15.982396 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9c6b949e-9a60-4685-8b6f-b3b8e79c7b22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:15.994950 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c6b949e-9a60-4685-8b6f-b3b8e79c7b22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:15.998373 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c6b949e-9a60-4685-8b6f-b3b8e79c7b22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:16.002240 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c6b949e-9a60-4685-8b6f-b3b8e79c7b22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:16.002889 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c6b949e-9a60-4685-8b6f-b3b8e79c7b22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:16.211161 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9c6b949e-9a60-4685-8b6f-b3b8e79c7b22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:16.219927 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9c6b949e-9a60-4685-8b6f-b3b8e79c7b22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.245333 Apr 05 11:14:16.231150 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 65/129] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:15 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:16.608014 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-65883ed7-1dfe-43eb-a557-5049c93dccdc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a5c2bb9-2208-46fd-acde-fee198ba3221"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:14:16.609220 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-65883ed7-1dfe-43eb-a557-5049c93dccdc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:16.615997 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-65883ed7-1dfe-43eb-a557-5049c93dccdc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:16.616516 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-65883ed7-1dfe-43eb-a557-5049c93dccdc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:16.617364 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-65883ed7-1dfe-43eb-a557-5049c93dccdc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:16.617885 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-65883ed7-1dfe-43eb-a557-5049c93dccdc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:16.942043 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4d0c85af-37d4-4be5-9897-8a86736ff8f4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:16.942699 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4d0c85af-37d4-4be5-9897-8a86736ff8f4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:16.950122 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d0c85af-37d4-4be5-9897-8a86736ff8f4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:16.950819 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d0c85af-37d4-4be5-9897-8a86736ff8f4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:16.951748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d0c85af-37d4-4be5-9897-8a86736ff8f4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:16.952348 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d0c85af-37d4-4be5-9897-8a86736ff8f4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:17.124020 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4d0c85af-37d4-4be5-9897-8a86736ff8f4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:17.132249 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4d0c85af-37d4-4be5-9897-8a86736ff8f4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1362 microversion: 2.1 time: 0.194627 Apr 05 11:14:17.133757 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 66/130] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:16 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:17.239326 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7a29e90c-ed29-47fb-aeaa-5b71611d121e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:17.239872 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7a29e90c-ed29-47fb-aeaa-5b71611d121e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:17.246630 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a29e90c-ed29-47fb-aeaa-5b71611d121e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:17.247092 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a29e90c-ed29-47fb-aeaa-5b71611d121e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:17.247898 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a29e90c-ed29-47fb-aeaa-5b71611d121e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:17.248335 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a29e90c-ed29-47fb-aeaa-5b71611d121e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:17.408270 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7a29e90c-ed29-47fb-aeaa-5b71611d121e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:17.416061 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7a29e90c-ed29-47fb-aeaa-5b71611d121e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.181065 Apr 05 11:14:17.417039 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 67/131] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:17 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:17.421830 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-e243c9e9-0b4b-4380-ad96-7249efb5fa85 req-d4ad8b94-924d-4036-8369-014a557f8478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c900362d-904b-4d64-a9a3-ab381ca756e3", "tag": "be14224c-0258-4dc2-9ce4-f41347c20fc0"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:14:17.430246 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-e243c9e9-0b4b-4380-ad96-7249efb5fa85 req-d4ad8b94-924d-4036-8369-014a557f8478 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:17.431472 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-e243c9e9-0b4b-4380-ad96-7249efb5fa85 req-d4ad8b94-924d-4036-8369-014a557f8478 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:17.443565 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-e243c9e9-0b4b-4380-ad96-7249efb5fa85 req-d4ad8b94-924d-4036-8369-014a557f8478 service nova] Creating event network-changed:be14224c-0258-4dc2-9ce4-f41347c20fc0 for instance c900362d-904b-4d64-a9a3-ab381ca756e3 on hv-cinder-81899 Apr 05 11:14:17.449807 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-e243c9e9-0b4b-4380-ad96-7249efb5fa85 req-d4ad8b94-924d-4036-8369-014a557f8478 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031127 Apr 05 11:14:17.451105 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 68/132] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:14:18.150117 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-39773cea-1a7d-4edc-abb7-f35b2c8f3818 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:18.150842 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-39773cea-1a7d-4edc-abb7-f35b2c8f3818 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:18.157327 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39773cea-1a7d-4edc-abb7-f35b2c8f3818 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:18.157770 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39773cea-1a7d-4edc-abb7-f35b2c8f3818 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:18.158629 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39773cea-1a7d-4edc-abb7-f35b2c8f3818 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:18.159065 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39773cea-1a7d-4edc-abb7-f35b2c8f3818 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:18.388661 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-39773cea-1a7d-4edc-abb7-f35b2c8f3818 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:18.399403 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-39773cea-1a7d-4edc-abb7-f35b2c8f3818 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1362 microversion: 2.1 time: 0.253510 Apr 05 11:14:18.434720 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 69/133] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:18 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:18.454008 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d021ae20-65dd-482b-ad26-035164dbf728 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:18.465757 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d021ae20-65dd-482b-ad26-035164dbf728 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:18.472963 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d021ae20-65dd-482b-ad26-035164dbf728 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:18.473595 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d021ae20-65dd-482b-ad26-035164dbf728 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:18.474522 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d021ae20-65dd-482b-ad26-035164dbf728 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:18.475255 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d021ae20-65dd-482b-ad26-035164dbf728 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:18.713655 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d021ae20-65dd-482b-ad26-035164dbf728 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:18.722468 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d021ae20-65dd-482b-ad26-035164dbf728 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.283449 Apr 05 11:14:18.726946 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 70/134] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:18 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:19.418781 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d76c3fde-e73f-440a-b4a1-a9ef29a8f49e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:19.419394 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d76c3fde-e73f-440a-b4a1-a9ef29a8f49e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:19.425637 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d76c3fde-e73f-440a-b4a1-a9ef29a8f49e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:19.426094 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d76c3fde-e73f-440a-b4a1-a9ef29a8f49e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:19.426952 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d76c3fde-e73f-440a-b4a1-a9ef29a8f49e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:19.427529 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d76c3fde-e73f-440a-b4a1-a9ef29a8f49e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:19.816988 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d76c3fde-e73f-440a-b4a1-a9ef29a8f49e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:19.825616 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d76c3fde-e73f-440a-b4a1-a9ef29a8f49e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1547 microversion: 2.1 time: 0.410804 Apr 05 11:14:19.835026 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 71/135] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:19 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1547 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:19.849331 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3cb075f6-e9e0-4517-97b0-2061741a64cb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:19.851935 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3cb075f6-e9e0-4517-97b0-2061741a64cb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:19.859425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3cb075f6-e9e0-4517-97b0-2061741a64cb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:19.860260 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3cb075f6-e9e0-4517-97b0-2061741a64cb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:19.861845 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3cb075f6-e9e0-4517-97b0-2061741a64cb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:19.862585 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3cb075f6-e9e0-4517-97b0-2061741a64cb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:19.908321 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-65883ed7-1dfe-43eb-a557-5049c93dccdc tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "POST /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.305059 Apr 05 11:14:19.909050 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 65/136] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:14:16 2022] POST /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8/os-volume_attachments => generated 194 bytes in 3307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:14:19.919083 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a98fea96-ad6f-45e8-9a4e-8c854229ad98 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:19.919698 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a98fea96-ad6f-45e8-9a4e-8c854229ad98 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:19.933242 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a98fea96-ad6f-45e8-9a4e-8c854229ad98 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:19.933714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a98fea96-ad6f-45e8-9a4e-8c854229ad98 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:19.934562 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a98fea96-ad6f-45e8-9a4e-8c854229ad98 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:19.935312 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a98fea96-ad6f-45e8-9a4e-8c854229ad98 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:20.139917 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a98fea96-ad6f-45e8-9a4e-8c854229ad98 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.229449 Apr 05 11:14:20.140792 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 66/137] 10.222.0.39 () {58 vars in 1274 bytes} [Tue Apr 5 11:14:19 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/os-interface => generated 284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:14:20.435570 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3cb075f6-e9e0-4517-97b0-2061741a64cb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:20.460716 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3cb075f6-e9e0-4517-97b0-2061741a64cb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.623733 Apr 05 11:14:20.462860 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 72/138] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:19 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:21.481237 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bff52b81-35f0-4bc0-a082-1194366e123f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:21.482038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bff52b81-35f0-4bc0-a082-1194366e123f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:21.494465 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bff52b81-35f0-4bc0-a082-1194366e123f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:21.495239 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bff52b81-35f0-4bc0-a082-1194366e123f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:21.496254 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bff52b81-35f0-4bc0-a082-1194366e123f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:21.496866 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bff52b81-35f0-4bc0-a082-1194366e123f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:21.846196 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bff52b81-35f0-4bc0-a082-1194366e123f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:21.857275 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bff52b81-35f0-4bc0-a082-1194366e123f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.381071 Apr 05 11:14:21.866940 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 67/139] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:21 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:21.991712 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-f5ab6e38-4662-4876-85dd-b3e3214bfcb4 req-0a9f49da-2396-42c9-846b-25085fffbe65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a98ab2b1-5651-42f4-b1f3-de4469d542ad", "tag": "dc7aebba-05fe-428c-9500-aeca3f7e1c99"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:14:22.008613 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-f5ab6e38-4662-4876-85dd-b3e3214bfcb4 req-0a9f49da-2396-42c9-846b-25085fffbe65 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:22.010095 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-f5ab6e38-4662-4876-85dd-b3e3214bfcb4 req-0a9f49da-2396-42c9-846b-25085fffbe65 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:22.034133 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-f5ab6e38-4662-4876-85dd-b3e3214bfcb4 req-0a9f49da-2396-42c9-846b-25085fffbe65 service nova] Creating event network-changed:dc7aebba-05fe-428c-9500-aeca3f7e1c99 for instance a98ab2b1-5651-42f4-b1f3-de4469d542ad on hv-cinder-81899 Apr 05 11:14:22.045653 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-f5ab6e38-4662-4876-85dd-b3e3214bfcb4 req-0a9f49da-2396-42c9-846b-25085fffbe65 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060534 Apr 05 11:14:22.049640 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 73/140] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:14:22.877775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1007b353-c84b-4bcc-b7c1-9c72ca126635 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:22.879626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1007b353-c84b-4bcc-b7c1-9c72ca126635 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:22.889897 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1007b353-c84b-4bcc-b7c1-9c72ca126635 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:22.891066 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1007b353-c84b-4bcc-b7c1-9c72ca126635 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:22.893334 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1007b353-c84b-4bcc-b7c1-9c72ca126635 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:22.895076 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1007b353-c84b-4bcc-b7c1-9c72ca126635 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:23.148413 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1007b353-c84b-4bcc-b7c1-9c72ca126635 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:23.156686 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1007b353-c84b-4bcc-b7c1-9c72ca126635 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.285164 Apr 05 11:14:23.167383 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 68/141] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:22 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:23.635230 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-9c55d900-057a-43d5-a469-d14e67f46aec req-b3390182-c5a5-478c-bae3-3e9390269eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e206c1c-372e-45c5-bb53-11d7ba0fb01f", "name": "network-vif-plugged", "status": "completed", "tag": "f05746fb-fbaf-4f6f-a2a4-ac06ce53f6b6"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:14:23.646127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-9c55d900-057a-43d5-a469-d14e67f46aec req-b3390182-c5a5-478c-bae3-3e9390269eb3 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:23.647216 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-9c55d900-057a-43d5-a469-d14e67f46aec req-b3390182-c5a5-478c-bae3-3e9390269eb3 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:23.661687 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-9c55d900-057a-43d5-a469-d14e67f46aec req-b3390182-c5a5-478c-bae3-3e9390269eb3 service nova] Creating event network-vif-plugged:f05746fb-fbaf-4f6f-a2a4-ac06ce53f6b6 for instance 8e206c1c-372e-45c5-bb53-11d7ba0fb01f on hv-cinder-81899 Apr 05 11:14:23.671766 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-9c55d900-057a-43d5-a469-d14e67f46aec req-b3390182-c5a5-478c-bae3-3e9390269eb3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044506 Apr 05 11:14:23.673523 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 74/142] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:14:24.173748 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ba88d1b0-af94-45b1-93a7-bb4780768bad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:24.174388 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ba88d1b0-af94-45b1-93a7-bb4780768bad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:24.181832 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ba88d1b0-af94-45b1-93a7-bb4780768bad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:24.182037 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ba88d1b0-af94-45b1-93a7-bb4780768bad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:24.182744 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ba88d1b0-af94-45b1-93a7-bb4780768bad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:24.183172 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ba88d1b0-af94-45b1-93a7-bb4780768bad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:24.332396 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ba88d1b0-af94-45b1-93a7-bb4780768bad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:24.339816 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ba88d1b0-af94-45b1-93a7-bb4780768bad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.169864 Apr 05 11:14:24.340392 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 69/143] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:24 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:25.359387 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-07bfc990-8675-4472-af5b-8783193923e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:25.360460 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-07bfc990-8675-4472-af5b-8783193923e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:25.368015 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07bfc990-8675-4472-af5b-8783193923e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:25.372809 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07bfc990-8675-4472-af5b-8783193923e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:25.375310 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07bfc990-8675-4472-af5b-8783193923e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:25.377509 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07bfc990-8675-4472-af5b-8783193923e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:25.593644 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-07bfc990-8675-4472-af5b-8783193923e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:25.607035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-07bfc990-8675-4472-af5b-8783193923e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1366 microversion: 2.1 time: 0.247496 Apr 05 11:14:25.607035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 75/144] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:25 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:26.617285 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f85c4e54-2085-41f6-8b31-2ffc7c5b88f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:26.618910 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f85c4e54-2085-41f6-8b31-2ffc7c5b88f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:26.625803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f85c4e54-2085-41f6-8b31-2ffc7c5b88f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:26.626358 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f85c4e54-2085-41f6-8b31-2ffc7c5b88f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:26.627205 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f85c4e54-2085-41f6-8b31-2ffc7c5b88f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:26.627665 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f85c4e54-2085-41f6-8b31-2ffc7c5b88f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:26.769383 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f85c4e54-2085-41f6-8b31-2ffc7c5b88f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:26.777166 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f85c4e54-2085-41f6-8b31-2ffc7c5b88f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1556 microversion: 2.1 time: 0.163743 Apr 05 11:14:26.778448 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 70/145] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:26 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:26.802747 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-daba2b99-4ca4-4458-90cf-91801c42beca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:26.802747 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-daba2b99-4ca4-4458-90cf-91801c42beca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:26.808154 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-daba2b99-4ca4-4458-90cf-91801c42beca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:26.809385 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-daba2b99-4ca4-4458-90cf-91801c42beca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:26.810517 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-daba2b99-4ca4-4458-90cf-91801c42beca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:26.811033 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-daba2b99-4ca4-4458-90cf-91801c42beca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:26.903279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-daba2b99-4ca4-4458-90cf-91801c42beca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109602 Apr 05 11:14:26.904984 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 76/146] 10.222.0.39 () {58 vars in 1274 bytes} [Tue Apr 5 11:14:26 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:14:28.709196 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-39d3036b-464e-43c5-9780-27e8736eb554 req-6c737561-0034-43ee-b1a8-121905d877ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e206c1c-372e-45c5-bb53-11d7ba0fb01f", "tag": "f05746fb-fbaf-4f6f-a2a4-ac06ce53f6b6"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:14:28.720684 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-39d3036b-464e-43c5-9780-27e8736eb554 req-6c737561-0034-43ee-b1a8-121905d877ec service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:28.721116 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-39d3036b-464e-43c5-9780-27e8736eb554 req-6c737561-0034-43ee-b1a8-121905d877ec service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:28.737380 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-39d3036b-464e-43c5-9780-27e8736eb554 req-6c737561-0034-43ee-b1a8-121905d877ec service nova] Creating event network-changed:f05746fb-fbaf-4f6f-a2a4-ac06ce53f6b6 for instance 8e206c1c-372e-45c5-bb53-11d7ba0fb01f on hv-cinder-81899 Apr 05 11:14:28.743105 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-39d3036b-464e-43c5-9780-27e8736eb554 req-6c737561-0034-43ee-b1a8-121905d877ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040757 Apr 05 11:14:28.744519 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 71/147] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:14:30.123810 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-08e3809d-c868-4f40-b147-fca622559408 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:30.124393 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-08e3809d-c868-4f40-b147-fca622559408 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:30.130563 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08e3809d-c868-4f40-b147-fca622559408 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:30.131043 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08e3809d-c868-4f40-b147-fca622559408 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:30.131820 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08e3809d-c868-4f40-b147-fca622559408 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:30.132351 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08e3809d-c868-4f40-b147-fca622559408 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:30.156643 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-08e3809d-c868-4f40-b147-fca622559408 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:14:30.800383 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-08e3809d-c868-4f40-b147-fca622559408 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 204 len: 0 microversion: 2.1 time: 0.680435 Apr 05 11:14:30.801520 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 77/148] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:14:30 2022] DELETE /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:14:30.811738 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fd4fbed4-a355-4ccf-92f2-43918d8a1637 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:30.812476 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fd4fbed4-a355-4ccf-92f2-43918d8a1637 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:30.819942 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd4fbed4-a355-4ccf-92f2-43918d8a1637 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:30.820792 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd4fbed4-a355-4ccf-92f2-43918d8a1637 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:30.821825 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd4fbed4-a355-4ccf-92f2-43918d8a1637 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:30.823711 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd4fbed4-a355-4ccf-92f2-43918d8a1637 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:30.967157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fd4fbed4-a355-4ccf-92f2-43918d8a1637 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:30.975522 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fd4fbed4-a355-4ccf-92f2-43918d8a1637 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1553 microversion: 2.1 time: 0.168820 Apr 05 11:14:30.982771 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 72/149] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:30 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:14:31.994497 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8b3a09d4-8023-431d-a021-e3e1ca0d797b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:31.995340 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8b3a09d4-8023-431d-a021-e3e1ca0d797b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:32.001519 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8b3a09d4-8023-431d-a021-e3e1ca0d797b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:32.001970 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8b3a09d4-8023-431d-a021-e3e1ca0d797b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:32.002853 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8b3a09d4-8023-431d-a021-e3e1ca0d797b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:32.003502 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8b3a09d4-8023-431d-a021-e3e1ca0d797b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:32.159770 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8b3a09d4-8023-431d-a021-e3e1ca0d797b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:32.165333 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8b3a09d4-8023-431d-a021-e3e1ca0d797b tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1553 microversion: 2.1 time: 0.175025 Apr 05 11:14:32.165934 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 78/150] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:31 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:33.183404 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-18c11061-3928-4423-af98-69b000ba3497 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:33.184024 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-18c11061-3928-4423-af98-69b000ba3497 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:33.190724 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-18c11061-3928-4423-af98-69b000ba3497 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:33.191168 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-18c11061-3928-4423-af98-69b000ba3497 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:33.192256 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-18c11061-3928-4423-af98-69b000ba3497 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:33.192924 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-18c11061-3928-4423-af98-69b000ba3497 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:33.340670 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-18c11061-3928-4423-af98-69b000ba3497 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:33.348593 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-18c11061-3928-4423-af98-69b000ba3497 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1553 microversion: 2.1 time: 0.169567 Apr 05 11:14:33.349172 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 73/151] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:33 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:34.365211 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4694ceb5-5a85-460c-91ba-7521f367ee67 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:34.365919 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4694ceb5-5a85-460c-91ba-7521f367ee67 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:34.372578 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4694ceb5-5a85-460c-91ba-7521f367ee67 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:34.373027 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4694ceb5-5a85-460c-91ba-7521f367ee67 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:34.373794 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4694ceb5-5a85-460c-91ba-7521f367ee67 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:34.374299 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4694ceb5-5a85-460c-91ba-7521f367ee67 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:34.515826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4694ceb5-5a85-460c-91ba-7521f367ee67 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:34.524635 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4694ceb5-5a85-460c-91ba-7521f367ee67 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1553 microversion: 2.1 time: 0.163461 Apr 05 11:14:34.525385 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 79/152] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:34 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:35.541834 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-55614152-de2e-4031-a112-53efed35b153 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:35.542496 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-55614152-de2e-4031-a112-53efed35b153 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:35.549539 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55614152-de2e-4031-a112-53efed35b153 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:35.550255 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55614152-de2e-4031-a112-53efed35b153 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:35.550816 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55614152-de2e-4031-a112-53efed35b153 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:35.551285 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55614152-de2e-4031-a112-53efed35b153 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:35.686355 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-55614152-de2e-4031-a112-53efed35b153 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:35.694062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-55614152-de2e-4031-a112-53efed35b153 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1553 microversion: 2.1 time: 0.156132 Apr 05 11:14:35.694653 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 74/153] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:35 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:36.713625 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-aea1ff34-c059-4220-b813-a54281f9acc9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:36.714234 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-aea1ff34-c059-4220-b813-a54281f9acc9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:36.720130 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aea1ff34-c059-4220-b813-a54281f9acc9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:36.720578 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aea1ff34-c059-4220-b813-a54281f9acc9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:36.721338 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aea1ff34-c059-4220-b813-a54281f9acc9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:36.721768 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aea1ff34-c059-4220-b813-a54281f9acc9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:36.854105 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-aea1ff34-c059-4220-b813-a54281f9acc9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:36.862025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-aea1ff34-c059-4220-b813-a54281f9acc9 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1553 microversion: 2.1 time: 0.152882 Apr 05 11:14:36.862599 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 80/154] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:36 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:37.880278 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bcdd99fe-2fb3-46ed-b640-13e68a8b3994 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:37.880889 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bcdd99fe-2fb3-46ed-b640-13e68a8b3994 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:37.888022 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bcdd99fe-2fb3-46ed-b640-13e68a8b3994 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:37.888472 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bcdd99fe-2fb3-46ed-b640-13e68a8b3994 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:37.889304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bcdd99fe-2fb3-46ed-b640-13e68a8b3994 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:37.889741 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bcdd99fe-2fb3-46ed-b640-13e68a8b3994 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:38.018848 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bcdd99fe-2fb3-46ed-b640-13e68a8b3994 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:38.026712 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bcdd99fe-2fb3-46ed-b640-13e68a8b3994 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1553 microversion: 2.1 time: 0.150340 Apr 05 11:14:38.027315 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 75/155] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:37 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:39.043825 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-27195ad5-307e-4883-9779-dec7ad3c0662 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:39.044434 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-27195ad5-307e-4883-9779-dec7ad3c0662 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:39.050587 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-27195ad5-307e-4883-9779-dec7ad3c0662 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:39.051069 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-27195ad5-307e-4883-9779-dec7ad3c0662 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:39.051838 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-27195ad5-307e-4883-9779-dec7ad3c0662 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:39.052274 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-27195ad5-307e-4883-9779-dec7ad3c0662 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:39.196021 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-27195ad5-307e-4883-9779-dec7ad3c0662 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:39.204939 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-27195ad5-307e-4883-9779-dec7ad3c0662 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1553 microversion: 2.1 time: 0.164886 Apr 05 11:14:39.205530 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 81/156] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:39 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:40.151981 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-bd6ca799-dcaf-43cd-a366-0bb2218952ba req-076b93ce-fb10-45c1-9301-22e4ce880ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8a287b-66c2-4188-acdf-60a0b6322df8", "name": "network-vif-deleted", "tag": "affc6f94-bfe4-441e-977e-50e2937e208e"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:14:40.160872 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-bd6ca799-dcaf-43cd-a366-0bb2218952ba req-076b93ce-fb10-45c1-9301-22e4ce880ea2 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:40.161305 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-bd6ca799-dcaf-43cd-a366-0bb2218952ba req-076b93ce-fb10-45c1-9301-22e4ce880ea2 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:40.173136 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-bd6ca799-dcaf-43cd-a366-0bb2218952ba req-076b93ce-fb10-45c1-9301-22e4ce880ea2 service nova] Creating event network-vif-deleted:affc6f94-bfe4-441e-977e-50e2937e208e for instance 0d8a287b-66c2-4188-acdf-60a0b6322df8 on hv-cinder-81899 Apr 05 11:14:40.178449 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-bd6ca799-dcaf-43cd-a366-0bb2218952ba req-076b93ce-fb10-45c1-9301-22e4ce880ea2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030669 Apr 05 11:14:40.179192 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 76/157] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:14:40.222314 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-185ba321-8601-4daf-a75b-379430c2f8d3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:40.222965 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-185ba321-8601-4daf-a75b-379430c2f8d3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:40.229824 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-185ba321-8601-4daf-a75b-379430c2f8d3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:40.230292 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-185ba321-8601-4daf-a75b-379430c2f8d3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:40.231105 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-185ba321-8601-4daf-a75b-379430c2f8d3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:40.231542 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-185ba321-8601-4daf-a75b-379430c2f8d3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:40.294579 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-185ba321-8601-4daf-a75b-379430c2f8d3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:40.303376 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-185ba321-8601-4daf-a75b-379430c2f8d3 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1511 microversion: 2.1 time: 0.084896 Apr 05 11:14:40.304155 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 82/158] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:40 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:41.321924 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c61346f2-af4e-4197-8ecf-5b6f26a1ea8c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:41.322649 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c61346f2-af4e-4197-8ecf-5b6f26a1ea8c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:41.329283 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c61346f2-af4e-4197-8ecf-5b6f26a1ea8c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:41.329740 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c61346f2-af4e-4197-8ecf-5b6f26a1ea8c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:41.330515 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c61346f2-af4e-4197-8ecf-5b6f26a1ea8c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:41.330994 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c61346f2-af4e-4197-8ecf-5b6f26a1ea8c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:41.598510 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c61346f2-af4e-4197-8ecf-5b6f26a1ea8c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:41.607136 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c61346f2-af4e-4197-8ecf-5b6f26a1ea8c tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1345 microversion: 2.1 time: 0.289481 Apr 05 11:14:41.607713 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 77/159] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:41 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1345 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:42.624549 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-71484fa1-8328-4dcf-a381-8e76349aea03 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:42.625333 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-71484fa1-8328-4dcf-a381-8e76349aea03 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:42.631698 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-71484fa1-8328-4dcf-a381-8e76349aea03 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:42.632147 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-71484fa1-8328-4dcf-a381-8e76349aea03 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:42.632980 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-71484fa1-8328-4dcf-a381-8e76349aea03 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:42.633429 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-71484fa1-8328-4dcf-a381-8e76349aea03 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:42.695963 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-71484fa1-8328-4dcf-a381-8e76349aea03 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:42.703899 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-71484fa1-8328-4dcf-a381-8e76349aea03 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1345 microversion: 2.1 time: 0.083318 Apr 05 11:14:42.704473 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 83/160] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:42 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:43.720841 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4435adca-abd8-4b90-ba58-e9db33e22c2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:43.721455 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4435adca-abd8-4b90-ba58-e9db33e22c2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:43.728494 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4435adca-abd8-4b90-ba58-e9db33e22c2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:43.728939 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4435adca-abd8-4b90-ba58-e9db33e22c2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:43.729705 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4435adca-abd8-4b90-ba58-e9db33e22c2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:43.730137 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4435adca-abd8-4b90-ba58-e9db33e22c2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:43.790148 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4435adca-abd8-4b90-ba58-e9db33e22c2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:43.799229 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4435adca-abd8-4b90-ba58-e9db33e22c2f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1345 microversion: 2.1 time: 0.082194 Apr 05 11:14:43.799821 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 78/161] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:43 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:44.815994 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0aa941c4-568c-4590-82eb-4f009a3dfe31 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:44.816597 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0aa941c4-568c-4590-82eb-4f009a3dfe31 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:44.822574 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0aa941c4-568c-4590-82eb-4f009a3dfe31 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:44.823053 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0aa941c4-568c-4590-82eb-4f009a3dfe31 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:44.823815 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0aa941c4-568c-4590-82eb-4f009a3dfe31 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:44.824250 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0aa941c4-568c-4590-82eb-4f009a3dfe31 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:44.883901 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0aa941c4-568c-4590-82eb-4f009a3dfe31 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:44.891858 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0aa941c4-568c-4590-82eb-4f009a3dfe31 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1345 microversion: 2.1 time: 0.079813 Apr 05 11:14:44.892435 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 84/162] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:44 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:45.908321 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5ae5a255-3ec9-4f4d-9477-965877210317 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:45.908963 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5ae5a255-3ec9-4f4d-9477-965877210317 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:45.915845 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5ae5a255-3ec9-4f4d-9477-965877210317 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:45.916290 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5ae5a255-3ec9-4f4d-9477-965877210317 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:45.917051 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5ae5a255-3ec9-4f4d-9477-965877210317 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:45.917484 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5ae5a255-3ec9-4f4d-9477-965877210317 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:45.975928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5ae5a255-3ec9-4f4d-9477-965877210317 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:45.984546 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5ae5a255-3ec9-4f4d-9477-965877210317 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1345 microversion: 2.1 time: 0.080404 Apr 05 11:14:45.985133 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 79/163] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:45 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:47.001255 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dca05d78-02b6-48da-8e5c-7207cd530247 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:47.001874 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dca05d78-02b6-48da-8e5c-7207cd530247 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:47.008182 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dca05d78-02b6-48da-8e5c-7207cd530247 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:47.008634 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dca05d78-02b6-48da-8e5c-7207cd530247 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:47.009544 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dca05d78-02b6-48da-8e5c-7207cd530247 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:47.010121 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dca05d78-02b6-48da-8e5c-7207cd530247 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:47.080716 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dca05d78-02b6-48da-8e5c-7207cd530247 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fb5d85f7cc4df69dfd84c1ae5a706e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ef6623f6b4e4c88f74aafdb472163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:14:47.089529 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dca05d78-02b6-48da-8e5c-7207cd530247 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 200 len: 1345 microversion: 2.1 time: 0.092307 Apr 05 11:14:47.090231 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 85/164] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:46 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 1345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:14:48.112750 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9e9e4c0e-ea12-4853-ad64-791ef8914726 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:48.113356 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9e9e4c0e-ea12-4853-ad64-791ef8914726 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:48.119533 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9e9e4c0e-ea12-4853-ad64-791ef8914726 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:48.119999 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9e9e4c0e-ea12-4853-ad64-791ef8914726 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:48.120771 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9e9e4c0e-ea12-4853-ad64-791ef8914726 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:48.121201 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9e9e4c0e-ea12-4853-ad64-791ef8914726 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:48.135245 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-9e9e4c0e-ea12-4853-ad64-791ef8914726 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] HTTP exception thrown: Instance 0d8a287b-66c2-4188-acdf-60a0b6322df8 could not be found. Apr 05 11:14:48.135961 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9e9e4c0e-ea12-4853-ad64-791ef8914726 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Returning 404 to user: Instance 0d8a287b-66c2-4188-acdf-60a0b6322df8 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:14:48.136791 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9e9e4c0e-ea12-4853-ad64-791ef8914726 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 404 len: 111 microversion: 2.1 time: 0.028101 Apr 05 11:14:48.137347 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 80/165] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:48 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:14:48.248679 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2d04759c-7886-4641-9787-22b1415b45dd tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:48.254594 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2d04759c-7886-4641-9787-22b1415b45dd tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:48.256311 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d04759c-7886-4641-9787-22b1415b45dd tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:48.256754 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d04759c-7886-4641-9787-22b1415b45dd tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:48.257608 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d04759c-7886-4641-9787-22b1415b45dd tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:48.258075 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d04759c-7886-4641-9787-22b1415b45dd tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:48.270942 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-2d04759c-7886-4641-9787-22b1415b45dd tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] HTTP exception thrown: Instance 0d8a287b-66c2-4188-acdf-60a0b6322df8 could not be found. Apr 05 11:14:48.271543 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2d04759c-7886-4641-9787-22b1415b45dd tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Returning 404 to user: Instance 0d8a287b-66c2-4188-acdf-60a0b6322df8 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:14:48.272466 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2d04759c-7886-4641-9787-22b1415b45dd tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027914 Apr 05 11:14:48.273244 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 86/166] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:14:48 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:14:49.600360 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-276b6b30-8a8f-4b7b-867b-ed04d80bfe7f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:49.600937 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-276b6b30-8a8f-4b7b-867b-ed04d80bfe7f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:49.608230 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-276b6b30-8a8f-4b7b-867b-ed04d80bfe7f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:49.608807 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-276b6b30-8a8f-4b7b-867b-ed04d80bfe7f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:49.609768 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-276b6b30-8a8f-4b7b-867b-ed04d80bfe7f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:49.610278 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-276b6b30-8a8f-4b7b-867b-ed04d80bfe7f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:49.625546 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-276b6b30-8a8f-4b7b-867b-ed04d80bfe7f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] HTTP exception thrown: Instance 0d8a287b-66c2-4188-acdf-60a0b6322df8 could not be found. Apr 05 11:14:49.626222 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-276b6b30-8a8f-4b7b-867b-ed04d80bfe7f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Returning 404 to user: Instance 0d8a287b-66c2-4188-acdf-60a0b6322df8 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:14:49.627215 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-276b6b30-8a8f-4b7b-867b-ed04d80bfe7f tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 404 len: 111 microversion: 2.1 time: 0.030804 Apr 05 11:14:49.632660 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 81/167] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:14:49 2022] DELETE /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:14:49.639600 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b4095d02-2522-4cb3-9fd3-e96aee963895 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:14:49.640218 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b4095d02-2522-4cb3-9fd3-e96aee963895 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] [instance: 0d8a287b-66c2-4188-acdf-60a0b6322df8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:14:49.646141 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b4095d02-2522-4cb3-9fd3-e96aee963895 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:49.646595 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b4095d02-2522-4cb3-9fd3-e96aee963895 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:49.647414 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b4095d02-2522-4cb3-9fd3-e96aee963895 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:14:49.647900 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b4095d02-2522-4cb3-9fd3-e96aee963895 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:14:49.662533 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-b4095d02-2522-4cb3-9fd3-e96aee963895 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] HTTP exception thrown: Instance 0d8a287b-66c2-4188-acdf-60a0b6322df8 could not be found. Apr 05 11:14:49.663198 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b4095d02-2522-4cb3-9fd3-e96aee963895 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] Returning 404 to user: Instance 0d8a287b-66c2-4188-acdf-60a0b6322df8 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:14:49.664087 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b4095d02-2522-4cb3-9fd3-e96aee963895 tempest-DeleteServersTestJSON-29975717 tempest-DeleteServersTestJSON-29975717-project] 10.222.0.39 "GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8" status: 404 len: 111 microversion: 2.1 time: 0.028516 Apr 05 11:14:49.665213 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 87/168] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:14:49 2022] GET /compute/v2.1/servers/0d8a287b-66c2-4188-acdf-60a0b6322df8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:14:59.335130 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1761831078", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "networks": [{"uuid": "13b7e59c-4cc7-4c95-b837-f56effe02725"}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:14:59.396989 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] validate_networks() for [('13b7e59c-4cc7-4c95-b837-f56effe02725', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:15:00.107338 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:15:00.107338 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:15:00.107338 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:15:00.107338 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:15:00.107338 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:15:00.120748 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:00.121230 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:00.122110 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:00.122553 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:00.164956 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Getting quotas for project da48f033c24346cc90296be17f7d07cc. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:15:00.172420 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Getting quotas for user bb9be3affb1042eea0f9084b632c824d and project da48f033c24346cc90296be17f7d07cc. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:15:00.207723 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:15:00.212542 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:15:00.459377 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bfc14dc6-7bac-4831-b76c-09af7fbdc26d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125614 Apr 05 11:15:00.460923 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 82/169] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:14:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:15:00.475244 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d15e2ad1-e3fc-42f8-bbcf-371263ae50d0 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:00.475860 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d15e2ad1-e3fc-42f8-bbcf-371263ae50d0 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:00.621493 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d15e2ad1-e3fc-42f8-bbcf-371263ae50d0 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:00.628925 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d15e2ad1-e3fc-42f8-bbcf-371263ae50d0 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1214 microversion: 2.1 time: 0.159978 Apr 05 11:15:00.640975 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 88/170] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:00 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:01.438255 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-149293568", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:01.495561 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] validate_networks() for [('a84177b0-98a3-43e8-9748-217cec2ce77a', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:15:01.649068 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8ccb2ff2-b42f-47e4-b547-506c5420b39e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:01.649737 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8ccb2ff2-b42f-47e4-b547-506c5420b39e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:01.716955 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8ccb2ff2-b42f-47e4-b547-506c5420b39e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:01.727386 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8ccb2ff2-b42f-47e4-b547-506c5420b39e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1214 microversion: 2.1 time: 0.081936 Apr 05 11:15:01.728360 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 89/171] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:01 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:02.176162 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:15:02.176162 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:15:02.176162 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:15:02.176162 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:15:02.176162 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:15:02.209161 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:02.211622 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:02.212640 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:02.214128 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:02.246633 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Getting quotas for project cf751cbfd21e463e83beea4d29713404. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:15:02.251495 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Getting quotas for user 2c4fa0f1800044a5bb00641ed885841f and project cf751cbfd21e463e83beea4d29713404. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:15:02.268190 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:15:02.269493 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:15:02.389069 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1acf2e4e-d029-4622-9cdd-0a796f43048c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.083607 Apr 05 11:15:02.389807 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 83/172] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:15:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:15:02.400419 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-923fa12c-0c03-47c6-b031-17db047d7718 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:02.401037 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-923fa12c-0c03-47c6-b031-17db047d7718 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:02.465548 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-923fa12c-0c03-47c6-b031-17db047d7718 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:02.472343 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-923fa12c-0c03-47c6-b031-17db047d7718 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1221 microversion: 2.1 time: 0.076204 Apr 05 11:15:02.473472 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 90/173] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:02 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:02.609694 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-476526975", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:02.662315 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] validate_networks() for [('a84177b0-98a3-43e8-9748-217cec2ce77a', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:15:02.751512 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-36787898-f013-46c6-93ac-4e6c631128cb tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:02.752136 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-36787898-f013-46c6-93ac-4e6c631128cb tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:02.758888 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36787898-f013-46c6-93ac-4e6c631128cb tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:02.759334 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36787898-f013-46c6-93ac-4e6c631128cb tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:02.760406 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36787898-f013-46c6-93ac-4e6c631128cb tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:02.760885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36787898-f013-46c6-93ac-4e6c631128cb tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:02.855631 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-36787898-f013-46c6-93ac-4e6c631128cb tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:02.869957 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-36787898-f013-46c6-93ac-4e6c631128cb tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1210 microversion: 2.1 time: 0.123080 Apr 05 11:15:02.875880 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 91/174] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:02 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:03.104129 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:15:03.105031 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:15:03.105661 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:15:03.110786 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:15:03.110786 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:15:03.116855 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:03.117511 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:03.118469 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:03.119087 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:03.138418 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Getting quotas for project cf751cbfd21e463e83beea4d29713404. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:15:03.143224 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Getting quotas for user 2c4fa0f1800044a5bb00641ed885841f and project cf751cbfd21e463e83beea4d29713404. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:15:03.155998 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:15:03.158214 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:15:03.414126 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-86acc7e0-34af-461f-ac0a-b57126b67834 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.808584 Apr 05 11:15:03.415581 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 84/175] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:15:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 11:15:03.425790 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b3647fed-cc33-498e-a58d-08d75dc0ec08 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:03.430984 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b3647fed-cc33-498e-a58d-08d75dc0ec08 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:03.564298 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b3647fed-cc33-498e-a58d-08d75dc0ec08 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:03.575138 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b3647fed-cc33-498e-a58d-08d75dc0ec08 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1221 microversion: 2.1 time: 0.153148 Apr 05 11:15:03.584573 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 92/176] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:03 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1221 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:03.888661 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-eaa5a750-25dd-4dc0-a8cb-fc3983b56123 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:03.890537 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-eaa5a750-25dd-4dc0-a8cb-fc3983b56123 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:03.897399 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eaa5a750-25dd-4dc0-a8cb-fc3983b56123 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:03.898626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eaa5a750-25dd-4dc0-a8cb-fc3983b56123 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:03.903073 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eaa5a750-25dd-4dc0-a8cb-fc3983b56123 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:03.903073 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eaa5a750-25dd-4dc0-a8cb-fc3983b56123 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:03.998716 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-eaa5a750-25dd-4dc0-a8cb-fc3983b56123 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:04.009721 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-eaa5a750-25dd-4dc0-a8cb-fc3983b56123 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1274 microversion: 2.1 time: 0.125430 Apr 05 11:15:04.023594 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 85/177] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:03 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:04.592941 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5ebed994-49b8-47a4-bcbe-c306c7ea5b25 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:04.593545 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5ebed994-49b8-47a4-bcbe-c306c7ea5b25 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:04.689809 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5ebed994-49b8-47a4-bcbe-c306c7ea5b25 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:04.698056 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5ebed994-49b8-47a4-bcbe-c306c7ea5b25 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1221 microversion: 2.1 time: 0.109097 Apr 05 11:15:04.699258 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 93/178] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:04 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:05.049052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-769f1a86-6d7f-4331-90ad-f5605a17e5b8 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:05.053550 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-769f1a86-6d7f-4331-90ad-f5605a17e5b8 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:05.069371 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-769f1a86-6d7f-4331-90ad-f5605a17e5b8 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:05.069618 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-769f1a86-6d7f-4331-90ad-f5605a17e5b8 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:05.070687 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-769f1a86-6d7f-4331-90ad-f5605a17e5b8 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:05.071285 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-769f1a86-6d7f-4331-90ad-f5605a17e5b8 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:05.282206 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-769f1a86-6d7f-4331-90ad-f5605a17e5b8 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:05.297651 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-769f1a86-6d7f-4331-90ad-f5605a17e5b8 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.260349 Apr 05 11:15:05.297651 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 86/179] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:05 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:05.483130 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1478341592", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:05.563613 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] validate_networks() for None {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:15:05.715118 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fece5ad5-2b99-4700-9c8a-e4a2c634b439 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:05.716190 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fece5ad5-2b99-4700-9c8a-e4a2c634b439 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:05.722369 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fece5ad5-2b99-4700-9c8a-e4a2c634b439 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:05.722848 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fece5ad5-2b99-4700-9c8a-e4a2c634b439 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:05.723618 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fece5ad5-2b99-4700-9c8a-e4a2c634b439 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:05.724048 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fece5ad5-2b99-4700-9c8a-e4a2c634b439 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:05.817816 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fece5ad5-2b99-4700-9c8a-e4a2c634b439 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:05.827639 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fece5ad5-2b99-4700-9c8a-e4a2c634b439 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1225 microversion: 2.1 time: 0.116134 Apr 05 11:15:05.829068 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 87/180] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:05 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:06.014363 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:15:06.014888 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:15:06.015291 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:15:06.015778 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:15:06.016194 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:15:06.030861 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:06.031548 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:06.032542 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:06.033141 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:06.056262 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Getting quotas for project e46a31684ddc4f1791f1567eb691022c. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:15:06.060634 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Getting quotas for user 7272395388d14ee3991d3026cb9e83a9 and project e46a31684ddc4f1791f1567eb691022c. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:15:06.072329 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:15:06.074637 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:15:06.249523 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eab1ba90-02de-4cf8-8e52-422c964c3dd6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771410 Apr 05 11:15:06.256190 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 94/181] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:15:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:15:06.261688 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-60ec501c-fd64-4d81-b864-13da8411cd82 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:06.262268 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-60ec501c-fd64-4d81-b864-13da8411cd82 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:06.312287 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-348500c2-4283-48d5-84f4-88fe93c75351 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:06.313765 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-348500c2-4283-48d5-84f4-88fe93c75351 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:06.333424 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-348500c2-4283-48d5-84f4-88fe93c75351 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:06.333990 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-348500c2-4283-48d5-84f4-88fe93c75351 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:06.336730 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-348500c2-4283-48d5-84f4-88fe93c75351 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:06.337188 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-348500c2-4283-48d5-84f4-88fe93c75351 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:06.396735 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-60ec501c-fd64-4d81-b864-13da8411cd82 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:06.402485 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-60ec501c-fd64-4d81-b864-13da8411cd82 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1215 microversion: 2.1 time: 0.145391 Apr 05 11:15:06.404423 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 88/182] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:06 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:06.748248 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-348500c2-4283-48d5-84f4-88fe93c75351 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:06.757075 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-348500c2-4283-48d5-84f4-88fe93c75351 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.448895 Apr 05 11:15:06.758342 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 95/183] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:06 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:06.845699 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5f443dbd-ce61-4c9a-8b17-39e25c482ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:06.846307 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5f443dbd-ce61-4c9a-8b17-39e25c482ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:06.857722 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5f443dbd-ce61-4c9a-8b17-39e25c482ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:06.858177 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5f443dbd-ce61-4c9a-8b17-39e25c482ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:06.858996 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5f443dbd-ce61-4c9a-8b17-39e25c482ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:06.859475 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5f443dbd-ce61-4c9a-8b17-39e25c482ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:06.924115 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5f443dbd-ce61-4c9a-8b17-39e25c482ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:06.932129 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5f443dbd-ce61-4c9a-8b17-39e25c482ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1273 microversion: 2.1 time: 0.090387 Apr 05 11:15:06.932901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 89/184] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:06 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:07.212014 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-703adde3-5914-42bc-b2d1-7cab2e073d16 req-4e657b46-7454-4d19-a98c-f7656831b2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37f4141f-bac2-4e5c-9171-881df70931e8", "tag": "0747daec-ec58-48af-85b4-85470275e1a5"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:07.221505 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-703adde3-5914-42bc-b2d1-7cab2e073d16 req-4e657b46-7454-4d19-a98c-f7656831b2c1 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:07.232061 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-703adde3-5914-42bc-b2d1-7cab2e073d16 req-4e657b46-7454-4d19-a98c-f7656831b2c1 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:07.235467 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-703adde3-5914-42bc-b2d1-7cab2e073d16 req-4e657b46-7454-4d19-a98c-f7656831b2c1 service nova] Creating event network-changed:0747daec-ec58-48af-85b4-85470275e1a5 for instance 37f4141f-bac2-4e5c-9171-881df70931e8 on hv-cinder-81899 Apr 05 11:15:07.240907 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-703adde3-5914-42bc-b2d1-7cab2e073d16 req-4e657b46-7454-4d19-a98c-f7656831b2c1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033819 Apr 05 11:15:07.241908 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 96/185] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:15:07.422873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-824c4722-363f-4ffe-ad7e-81f617b7f75b tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:07.423666 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-824c4722-363f-4ffe-ad7e-81f617b7f75b tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:07.544958 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-824c4722-363f-4ffe-ad7e-81f617b7f75b tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:07.544958 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-824c4722-363f-4ffe-ad7e-81f617b7f75b tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1215 microversion: 2.1 time: 0.125919 Apr 05 11:15:07.544958 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 90/186] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:07 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1215 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:07.776906 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d77a2854-cc88-4de3-9a43-e59b788634ae tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:07.777792 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d77a2854-cc88-4de3-9a43-e59b788634ae tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:07.784851 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d77a2854-cc88-4de3-9a43-e59b788634ae tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:07.785405 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d77a2854-cc88-4de3-9a43-e59b788634ae tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:07.786200 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d77a2854-cc88-4de3-9a43-e59b788634ae tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:07.786804 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d77a2854-cc88-4de3-9a43-e59b788634ae tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:07.955702 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f1c40827-88c3-4121-8e0f-28a9b48c39c2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:07.956325 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f1c40827-88c3-4121-8e0f-28a9b48c39c2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:07.973548 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f1c40827-88c3-4121-8e0f-28a9b48c39c2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:07.976887 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f1c40827-88c3-4121-8e0f-28a9b48c39c2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:07.977728 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f1c40827-88c3-4121-8e0f-28a9b48c39c2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:07.978177 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f1c40827-88c3-4121-8e0f-28a9b48c39c2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:08.062892 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f1c40827-88c3-4121-8e0f-28a9b48c39c2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:08.089302 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f1c40827-88c3-4121-8e0f-28a9b48c39c2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1291 microversion: 2.1 time: 0.129814 Apr 05 11:15:08.090019 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 91/187] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:07 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1291 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:08.255763 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d77a2854-cc88-4de3-9a43-e59b788634ae tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:08.264732 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d77a2854-cc88-4de3-9a43-e59b788634ae tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.493141 Apr 05 11:15:08.274681 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 97/188] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:07 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:08.572239 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0d590c3d-a4b1-440c-ad52-8120b24ab022 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:08.573507 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0d590c3d-a4b1-440c-ad52-8120b24ab022 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:08.698016 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0d590c3d-a4b1-440c-ad52-8120b24ab022 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:08.705308 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0d590c3d-a4b1-440c-ad52-8120b24ab022 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1215 microversion: 2.1 time: 0.142146 Apr 05 11:15:08.706193 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 92/189] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:08 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:09.108951 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-76d58a9b-4369-4802-8da3-eedcac3f9cbb tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:09.109994 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-76d58a9b-4369-4802-8da3-eedcac3f9cbb tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:09.116871 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-76d58a9b-4369-4802-8da3-eedcac3f9cbb tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:09.117621 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-76d58a9b-4369-4802-8da3-eedcac3f9cbb tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:09.124665 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-76d58a9b-4369-4802-8da3-eedcac3f9cbb tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:09.124665 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-76d58a9b-4369-4802-8da3-eedcac3f9cbb tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:09.299398 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-be4f2618-69fd-466e-8138-95adef646c1c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:09.300309 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-be4f2618-69fd-466e-8138-95adef646c1c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:09.317348 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be4f2618-69fd-466e-8138-95adef646c1c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:09.318079 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be4f2618-69fd-466e-8138-95adef646c1c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:09.318933 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be4f2618-69fd-466e-8138-95adef646c1c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:09.320285 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be4f2618-69fd-466e-8138-95adef646c1c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:09.429638 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-76d58a9b-4369-4802-8da3-eedcac3f9cbb tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:09.445558 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-76d58a9b-4369-4802-8da3-eedcac3f9cbb tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.341089 Apr 05 11:15:09.455938 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 98/190] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:09 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:09.473104 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-be4f2618-69fd-466e-8138-95adef646c1c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:09.481813 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-be4f2618-69fd-466e-8138-95adef646c1c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.202935 Apr 05 11:15:09.483074 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 93/191] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:09 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:09.758818 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6502afcb-3c2f-4bfd-931d-0979f9976401 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:09.759870 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6502afcb-3c2f-4bfd-931d-0979f9976401 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:09.767283 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6502afcb-3c2f-4bfd-931d-0979f9976401 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:09.768302 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6502afcb-3c2f-4bfd-931d-0979f9976401 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:09.774112 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6502afcb-3c2f-4bfd-931d-0979f9976401 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:09.774112 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6502afcb-3c2f-4bfd-931d-0979f9976401 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:09.894199 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6502afcb-3c2f-4bfd-931d-0979f9976401 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:09.902472 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6502afcb-3c2f-4bfd-931d-0979f9976401 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1219 microversion: 2.1 time: 0.149385 Apr 05 11:15:09.906989 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 99/192] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:09 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:10.234419 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-79a10124-804a-4894-b44b-bcc1d0b11f0b req-92e25a48-569d-408f-8d6b-51aba30d42f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8f4506a-1e74-4699-938c-1fe000c3d0e7", "tag": "01522163-0d2a-4854-8bdc-d67d7aa1cd89"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:10.244413 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-79a10124-804a-4894-b44b-bcc1d0b11f0b req-92e25a48-569d-408f-8d6b-51aba30d42f7 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:10.244954 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-79a10124-804a-4894-b44b-bcc1d0b11f0b req-92e25a48-569d-408f-8d6b-51aba30d42f7 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:10.259077 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-79a10124-804a-4894-b44b-bcc1d0b11f0b req-92e25a48-569d-408f-8d6b-51aba30d42f7 service nova] Creating event network-changed:01522163-0d2a-4854-8bdc-d67d7aa1cd89 for instance e8f4506a-1e74-4699-938c-1fe000c3d0e7 on hv-cinder-81899 Apr 05 11:15:10.265576 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-79a10124-804a-4894-b44b-bcc1d0b11f0b req-92e25a48-569d-408f-8d6b-51aba30d42f7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037938 Apr 05 11:15:10.266442 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 94/193] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:15:10.465985 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9331080d-5b4a-41b4-b5eb-34c950a251fc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:10.466775 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9331080d-5b4a-41b4-b5eb-34c950a251fc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:10.473319 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9331080d-5b4a-41b4-b5eb-34c950a251fc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:10.474034 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9331080d-5b4a-41b4-b5eb-34c950a251fc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:10.475028 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9331080d-5b4a-41b4-b5eb-34c950a251fc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:10.475468 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9331080d-5b4a-41b4-b5eb-34c950a251fc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:10.499766 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5b888803-4aa2-451d-b359-5688566a701a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:10.500712 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5b888803-4aa2-451d-b359-5688566a701a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:10.507310 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5b888803-4aa2-451d-b359-5688566a701a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:10.508533 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5b888803-4aa2-451d-b359-5688566a701a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:10.508533 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5b888803-4aa2-451d-b359-5688566a701a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:10.508939 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5b888803-4aa2-451d-b359-5688566a701a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:10.626145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9331080d-5b4a-41b4-b5eb-34c950a251fc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:10.634271 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9331080d-5b4a-41b4-b5eb-34c950a251fc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.172378 Apr 05 11:15:10.639788 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 100/194] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:10 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:10.700014 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5b888803-4aa2-451d-b359-5688566a701a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:10.707245 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5b888803-4aa2-451d-b359-5688566a701a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.211965 Apr 05 11:15:10.707826 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 95/195] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:10 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:10.919987 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-925bf2c4-9bbe-44fd-8852-2a2b1a6b1df3 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:10.920596 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-925bf2c4-9bbe-44fd-8852-2a2b1a6b1df3 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:10.926343 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-925bf2c4-9bbe-44fd-8852-2a2b1a6b1df3 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:10.926829 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-925bf2c4-9bbe-44fd-8852-2a2b1a6b1df3 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:10.928786 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-925bf2c4-9bbe-44fd-8852-2a2b1a6b1df3 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:10.929124 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-925bf2c4-9bbe-44fd-8852-2a2b1a6b1df3 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:10.989778 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-925bf2c4-9bbe-44fd-8852-2a2b1a6b1df3 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:10.998109 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-925bf2c4-9bbe-44fd-8852-2a2b1a6b1df3 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1219 microversion: 2.1 time: 0.081527 Apr 05 11:15:10.998716 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 101/196] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:10 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:11.650356 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-de8662f9-d72c-46a7-a4a3-a49f37985d63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:11.650998 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-de8662f9-d72c-46a7-a4a3-a49f37985d63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:11.657476 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de8662f9-d72c-46a7-a4a3-a49f37985d63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:11.657917 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de8662f9-d72c-46a7-a4a3-a49f37985d63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:11.658714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de8662f9-d72c-46a7-a4a3-a49f37985d63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:11.659148 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de8662f9-d72c-46a7-a4a3-a49f37985d63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:11.725374 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f7df42a1-a313-434d-8582-66e1730d9d19 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:11.726720 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f7df42a1-a313-434d-8582-66e1730d9d19 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:11.732619 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7df42a1-a313-434d-8582-66e1730d9d19 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:11.733145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7df42a1-a313-434d-8582-66e1730d9d19 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:11.735035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7df42a1-a313-434d-8582-66e1730d9d19 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:11.735672 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7df42a1-a313-434d-8582-66e1730d9d19 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:11.824976 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-de8662f9-d72c-46a7-a4a3-a49f37985d63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:11.832422 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-de8662f9-d72c-46a7-a4a3-a49f37985d63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.185877 Apr 05 11:15:11.842459 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 96/197] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:11 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:11.941315 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f7df42a1-a313-434d-8582-66e1730d9d19 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:11.951430 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f7df42a1-a313-434d-8582-66e1730d9d19 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.229526 Apr 05 11:15:11.954908 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 102/198] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:11 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:12.020115 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1f3a2ed7-fcaa-4bb8-ade8-a6c1b2b930d6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:12.021297 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1f3a2ed7-fcaa-4bb8-ade8-a6c1b2b930d6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:12.029369 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1f3a2ed7-fcaa-4bb8-ade8-a6c1b2b930d6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:12.030105 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1f3a2ed7-fcaa-4bb8-ade8-a6c1b2b930d6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:12.031802 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1f3a2ed7-fcaa-4bb8-ade8-a6c1b2b930d6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:12.032327 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1f3a2ed7-fcaa-4bb8-ade8-a6c1b2b930d6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:12.114072 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1f3a2ed7-fcaa-4bb8-ade8-a6c1b2b930d6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:12.122044 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1f3a2ed7-fcaa-4bb8-ade8-a6c1b2b930d6 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1219 microversion: 2.1 time: 0.109176 Apr 05 11:15:12.122691 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 97/199] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:12 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:12.841266 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-5927a837-d3e1-42a1-bf33-99096cece512 req-c3f849d1-6352-44e6-ba9a-6d33b32b6394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b89d15-5832-49f1-936c-f8219d65c62b", "tag": "df7c1568-9880-4e21-856e-00b35d9664cd"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:12.850041 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-5927a837-d3e1-42a1-bf33-99096cece512 req-c3f849d1-6352-44e6-ba9a-6d33b32b6394 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:12.850373 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ddd174a9-0c23-45a3-b4be-542ba23ee088 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:12.850865 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-5927a837-d3e1-42a1-bf33-99096cece512 req-c3f849d1-6352-44e6-ba9a-6d33b32b6394 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:12.851035 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ddd174a9-0c23-45a3-b4be-542ba23ee088 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:12.858533 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ddd174a9-0c23-45a3-b4be-542ba23ee088 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:12.858533 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ddd174a9-0c23-45a3-b4be-542ba23ee088 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:12.859852 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ddd174a9-0c23-45a3-b4be-542ba23ee088 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:12.860439 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ddd174a9-0c23-45a3-b4be-542ba23ee088 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:12.863368 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-5927a837-d3e1-42a1-bf33-99096cece512 req-c3f849d1-6352-44e6-ba9a-6d33b32b6394 service nova] Creating event network-changed:df7c1568-9880-4e21-856e-00b35d9664cd for instance 31b89d15-5832-49f1-936c-f8219d65c62b on hv-cinder-81899 Apr 05 11:15:12.871273 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-5927a837-d3e1-42a1-bf33-99096cece512 req-c3f849d1-6352-44e6-ba9a-6d33b32b6394 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033668 Apr 05 11:15:12.871886 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 103/200] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:15:12.970353 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-75f966d9-9506-4cf8-bb46-ef206da29660 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:12.971764 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-75f966d9-9506-4cf8-bb46-ef206da29660 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:12.979683 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75f966d9-9506-4cf8-bb46-ef206da29660 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:12.980400 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75f966d9-9506-4cf8-bb46-ef206da29660 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:12.981495 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75f966d9-9506-4cf8-bb46-ef206da29660 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:12.982086 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75f966d9-9506-4cf8-bb46-ef206da29660 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:13.033924 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ddd174a9-0c23-45a3-b4be-542ba23ee088 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:13.043548 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ddd174a9-0c23-45a3-b4be-542ba23ee088 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.197701 Apr 05 11:15:13.044866 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 98/201] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:12 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:13.140201 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-03232b09-b321-4060-a8cf-1053cf848f2a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:13.142453 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-03232b09-b321-4060-a8cf-1053cf848f2a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:13.148764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03232b09-b321-4060-a8cf-1053cf848f2a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:13.149302 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03232b09-b321-4060-a8cf-1053cf848f2a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:13.150079 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03232b09-b321-4060-a8cf-1053cf848f2a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:13.150512 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03232b09-b321-4060-a8cf-1053cf848f2a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:13.213038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-03232b09-b321-4060-a8cf-1053cf848f2a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:13.216124 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-75f966d9-9506-4cf8-bb46-ef206da29660 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:13.220587 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-03232b09-b321-4060-a8cf-1053cf848f2a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1267 microversion: 2.1 time: 0.084319 Apr 05 11:15:13.221154 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 99/202] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:13 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:13.223996 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-75f966d9-9506-4cf8-bb46-ef206da29660 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.259099 Apr 05 11:15:13.224549 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 104/203] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:12 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:14.062030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-54e49004-3449-4003-b9c9-18094c60f198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:14.062723 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-54e49004-3449-4003-b9c9-18094c60f198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:14.069395 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-54e49004-3449-4003-b9c9-18094c60f198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:14.070344 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-54e49004-3449-4003-b9c9-18094c60f198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:14.071190 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-54e49004-3449-4003-b9c9-18094c60f198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:14.071627 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-54e49004-3449-4003-b9c9-18094c60f198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:14.216385 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-54e49004-3449-4003-b9c9-18094c60f198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:14.223755 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-54e49004-3449-4003-b9c9-18094c60f198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.165972 Apr 05 11:15:14.224328 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 100/204] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:14 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:14.238811 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1e07dd14-98d6-4515-9867-b545ea3da9bf tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:14.239425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1e07dd14-98d6-4515-9867-b545ea3da9bf tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:14.240808 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e43f73ef-3195-4059-a3f7-2b60af7d17d1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:14.241955 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e43f73ef-3195-4059-a3f7-2b60af7d17d1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:14.246183 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e07dd14-98d6-4515-9867-b545ea3da9bf tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:14.246660 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e07dd14-98d6-4515-9867-b545ea3da9bf tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:14.247644 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e07dd14-98d6-4515-9867-b545ea3da9bf tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:14.248089 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e07dd14-98d6-4515-9867-b545ea3da9bf tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:14.248657 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e43f73ef-3195-4059-a3f7-2b60af7d17d1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:14.249598 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e43f73ef-3195-4059-a3f7-2b60af7d17d1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:14.250448 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e43f73ef-3195-4059-a3f7-2b60af7d17d1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:14.251058 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e43f73ef-3195-4059-a3f7-2b60af7d17d1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:14.328852 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1e07dd14-98d6-4515-9867-b545ea3da9bf tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:14.336610 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1e07dd14-98d6-4515-9867-b545ea3da9bf tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1275 microversion: 2.1 time: 0.101877 Apr 05 11:15:14.346353 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 105/205] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:14 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:14.398799 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e43f73ef-3195-4059-a3f7-2b60af7d17d1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:14.420813 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e43f73ef-3195-4059-a3f7-2b60af7d17d1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.183642 Apr 05 11:15:14.421827 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 101/206] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:14 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:14.431562 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-7876f0ce-624a-45e3-bdeb-09c90114fcd2 req-e7bddf41-f0ba-4334-969a-0f6d2e4c3e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f4141f-bac2-4e5c-9171-881df70931e8", "name": "network-vif-plugged", "status": "completed", "tag": "0747daec-ec58-48af-85b4-85470275e1a5"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:14.436162 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-7876f0ce-624a-45e3-bdeb-09c90114fcd2 req-e7bddf41-f0ba-4334-969a-0f6d2e4c3e24 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:14.436798 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-7876f0ce-624a-45e3-bdeb-09c90114fcd2 req-e7bddf41-f0ba-4334-969a-0f6d2e4c3e24 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:14.448724 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-7876f0ce-624a-45e3-bdeb-09c90114fcd2 req-e7bddf41-f0ba-4334-969a-0f6d2e4c3e24 service nova] Creating event network-vif-plugged:0747daec-ec58-48af-85b4-85470275e1a5 for instance 37f4141f-bac2-4e5c-9171-881df70931e8 on hv-cinder-81899 Apr 05 11:15:14.453708 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-7876f0ce-624a-45e3-bdeb-09c90114fcd2 req-e7bddf41-f0ba-4334-969a-0f6d2e4c3e24 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033726 Apr 05 11:15:14.454466 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 106/207] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:15:14.464238 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-24434879", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "networks": [{"uuid": "9b0266a7-6806-42f5-be79-5cd7a53cbad0"}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:14.515452 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] validate_networks() for [('9b0266a7-6806-42f5-be79-5cd7a53cbad0', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:15:14.852530 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:15:14.852945 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:15:14.853412 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:15:14.853817 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:15:14.854245 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:15:14.862868 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:14.863326 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:14.864102 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:14.864532 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:14.882197 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Getting quotas for project cf76b11857e84565b9d171a41d7a3722. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:15:14.886288 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Getting quotas for user 4b660172403d4aadb143c04913dede54 and project cf76b11857e84565b9d171a41d7a3722. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:15:14.897348 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:15:14.900211 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:15:15.103797 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ff37673b-e255-4e97-a109-47e29e19a4f6 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643045 Apr 05 11:15:15.104425 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 102/208] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:15:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:15:15.114758 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-79274002-b6c3-4100-9d0f-a4c3a00ecaf3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:15.115435 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-79274002-b6c3-4100-9d0f-a4c3a00ecaf3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:15.170166 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-79274002-b6c3-4100-9d0f-a4c3a00ecaf3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:15.179046 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-79274002-b6c3-4100-9d0f-a4c3a00ecaf3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1217 microversion: 2.1 time: 0.068435 Apr 05 11:15:15.179955 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 107/209] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:15 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:15.240601 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8fed1e46-1c49-43f3-b326-8846a0680bbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:15.241207 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8fed1e46-1c49-43f3-b326-8846a0680bbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:15.247220 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8fed1e46-1c49-43f3-b326-8846a0680bbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:15.247663 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8fed1e46-1c49-43f3-b326-8846a0680bbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:15.248428 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8fed1e46-1c49-43f3-b326-8846a0680bbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:15.248862 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8fed1e46-1c49-43f3-b326-8846a0680bbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:15.353371 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-20594102-5a78-47e0-81a7-799340a726ca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:15.355205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-20594102-5a78-47e0-81a7-799340a726ca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:15.360174 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-20594102-5a78-47e0-81a7-799340a726ca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:15.360629 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-20594102-5a78-47e0-81a7-799340a726ca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:15.361427 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-20594102-5a78-47e0-81a7-799340a726ca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:15.361867 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-20594102-5a78-47e0-81a7-799340a726ca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:15.385535 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8fed1e46-1c49-43f3-b326-8846a0680bbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:15.393544 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8fed1e46-1c49-43f3-b326-8846a0680bbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.156698 Apr 05 11:15:15.394219 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 103/210] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:15 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:15.427055 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-20594102-5a78-47e0-81a7-799340a726ca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:15.434284 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-20594102-5a78-47e0-81a7-799340a726ca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1275 microversion: 2.1 time: 0.084878 Apr 05 11:15:15.434890 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 108/211] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:15 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:15.449298 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b52c53ea-30d8-484b-8a8f-09c454d6dc6a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:15.449904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b52c53ea-30d8-484b-8a8f-09c454d6dc6a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:15.455901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b52c53ea-30d8-484b-8a8f-09c454d6dc6a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:15.456343 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b52c53ea-30d8-484b-8a8f-09c454d6dc6a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:15.457101 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b52c53ea-30d8-484b-8a8f-09c454d6dc6a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:15.457530 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b52c53ea-30d8-484b-8a8f-09c454d6dc6a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:15.595520 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b52c53ea-30d8-484b-8a8f-09c454d6dc6a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:15.602923 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b52c53ea-30d8-484b-8a8f-09c454d6dc6a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.157390 Apr 05 11:15:15.603493 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 104/212] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:15 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:16.196182 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ee6a1e23-a4c4-4124-a125-2abb526d2e80 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:16.196785 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ee6a1e23-a4c4-4124-a125-2abb526d2e80 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:16.247004 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ee6a1e23-a4c4-4124-a125-2abb526d2e80 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:16.260178 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ee6a1e23-a4c4-4124-a125-2abb526d2e80 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1217 microversion: 2.1 time: 0.062685 Apr 05 11:15:16.260178 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 109/213] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:16 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:16.411318 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-38d3b3f1-981c-43b3-bdfc-3c406ac4c0b2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:16.411926 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-38d3b3f1-981c-43b3-bdfc-3c406ac4c0b2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:16.418884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38d3b3f1-981c-43b3-bdfc-3c406ac4c0b2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:16.419384 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38d3b3f1-981c-43b3-bdfc-3c406ac4c0b2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:16.420101 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38d3b3f1-981c-43b3-bdfc-3c406ac4c0b2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:16.420558 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38d3b3f1-981c-43b3-bdfc-3c406ac4c0b2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:16.451466 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2a848afe-69e2-43da-9668-031c5ed280ea tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:16.452227 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2a848afe-69e2-43da-9668-031c5ed280ea tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:16.458511 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2a848afe-69e2-43da-9668-031c5ed280ea tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:16.459065 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2a848afe-69e2-43da-9668-031c5ed280ea tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:16.460354 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2a848afe-69e2-43da-9668-031c5ed280ea tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:16.461035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2a848afe-69e2-43da-9668-031c5ed280ea tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:16.523954 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2a848afe-69e2-43da-9668-031c5ed280ea tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:16.532205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2a848afe-69e2-43da-9668-031c5ed280ea tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1275 microversion: 2.1 time: 0.084573 Apr 05 11:15:16.533115 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 110/214] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:16 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:16.560037 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-38d3b3f1-981c-43b3-bdfc-3c406ac4c0b2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:16.568141 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-38d3b3f1-981c-43b3-bdfc-3c406ac4c0b2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.160639 Apr 05 11:15:16.568745 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 105/215] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:16 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:16.619823 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-75e3746f-1034-4955-bd25-36741c5de363 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:16.620418 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-75e3746f-1034-4955-bd25-36741c5de363 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:16.626692 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75e3746f-1034-4955-bd25-36741c5de363 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:16.627142 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75e3746f-1034-4955-bd25-36741c5de363 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:16.627902 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75e3746f-1034-4955-bd25-36741c5de363 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:16.628507 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75e3746f-1034-4955-bd25-36741c5de363 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:16.765062 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-75e3746f-1034-4955-bd25-36741c5de363 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:16.773093 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-75e3746f-1034-4955-bd25-36741c5de363 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.156557 Apr 05 11:15:16.773670 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 111/216] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:16 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:17.271764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-29cb1de6-f912-4d9d-93f8-43f77102c300 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:17.272444 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-29cb1de6-f912-4d9d-93f8-43f77102c300 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:17.278796 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29cb1de6-f912-4d9d-93f8-43f77102c300 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:17.281796 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29cb1de6-f912-4d9d-93f8-43f77102c300 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:17.281796 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29cb1de6-f912-4d9d-93f8-43f77102c300 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:17.281796 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29cb1de6-f912-4d9d-93f8-43f77102c300 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:17.345612 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-29cb1de6-f912-4d9d-93f8-43f77102c300 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:17.353067 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-29cb1de6-f912-4d9d-93f8-43f77102c300 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1221 microversion: 2.1 time: 0.084984 Apr 05 11:15:17.353787 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 106/217] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:17 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:17.551690 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d78b52f6-432f-44ad-ad2c-a6e8167636e2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:17.552232 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d78b52f6-432f-44ad-ad2c-a6e8167636e2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:17.558768 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d78b52f6-432f-44ad-ad2c-a6e8167636e2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:17.559214 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d78b52f6-432f-44ad-ad2c-a6e8167636e2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:17.559967 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d78b52f6-432f-44ad-ad2c-a6e8167636e2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:17.560396 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d78b52f6-432f-44ad-ad2c-a6e8167636e2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:17.585092 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c020db5a-29a5-4eca-b7aa-125f405f1295 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:17.585705 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c020db5a-29a5-4eca-b7aa-125f405f1295 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:17.591762 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c020db5a-29a5-4eca-b7aa-125f405f1295 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:17.592213 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c020db5a-29a5-4eca-b7aa-125f405f1295 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:17.592982 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c020db5a-29a5-4eca-b7aa-125f405f1295 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:17.593423 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c020db5a-29a5-4eca-b7aa-125f405f1295 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:17.623647 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d78b52f6-432f-44ad-ad2c-a6e8167636e2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:17.631320 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d78b52f6-432f-44ad-ad2c-a6e8167636e2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1275 microversion: 2.1 time: 0.083579 Apr 05 11:15:17.631886 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 112/218] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:17 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:17.728999 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c020db5a-29a5-4eca-b7aa-125f405f1295 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:17.736270 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c020db5a-29a5-4eca-b7aa-125f405f1295 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.155023 Apr 05 11:15:17.736873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 107/219] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:17 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:17.789682 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6bf20f74-3790-4244-ade8-80440ba67688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:17.790320 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6bf20f74-3790-4244-ade8-80440ba67688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:17.796112 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6bf20f74-3790-4244-ade8-80440ba67688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:17.796558 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6bf20f74-3790-4244-ade8-80440ba67688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:17.797315 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6bf20f74-3790-4244-ade8-80440ba67688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:17.804273 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6bf20f74-3790-4244-ade8-80440ba67688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:17.928531 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6bf20f74-3790-4244-ade8-80440ba67688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:17.935850 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6bf20f74-3790-4244-ade8-80440ba67688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.150515 Apr 05 11:15:17.936416 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 113/220] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:17 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:18.369294 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e1c4df8a-2e63-4741-b23e-46e025413646 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:18.369834 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e1c4df8a-2e63-4741-b23e-46e025413646 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:18.376868 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1c4df8a-2e63-4741-b23e-46e025413646 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:18.377347 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1c4df8a-2e63-4741-b23e-46e025413646 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:18.378143 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1c4df8a-2e63-4741-b23e-46e025413646 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:18.378579 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1c4df8a-2e63-4741-b23e-46e025413646 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:18.436671 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e1c4df8a-2e63-4741-b23e-46e025413646 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:18.444208 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e1c4df8a-2e63-4741-b23e-46e025413646 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1221 microversion: 2.1 time: 0.078951 Apr 05 11:15:18.445331 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 108/221] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:18 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:18.648370 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-54681fe7-50ca-463a-817d-e3b36a4394d1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:18.648925 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-54681fe7-50ca-463a-817d-e3b36a4394d1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:18.655098 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54681fe7-50ca-463a-817d-e3b36a4394d1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:18.655557 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54681fe7-50ca-463a-817d-e3b36a4394d1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:18.656322 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54681fe7-50ca-463a-817d-e3b36a4394d1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:18.656757 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54681fe7-50ca-463a-817d-e3b36a4394d1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:18.717375 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-54681fe7-50ca-463a-817d-e3b36a4394d1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:18.724561 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-54681fe7-50ca-463a-817d-e3b36a4394d1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1275 microversion: 2.1 time: 0.080196 Apr 05 11:15:18.725122 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 114/222] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:18 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1275 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:18.753727 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a9f2c4f9-dd5c-4fe2-bc75-35c4f09ad9e7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:18.754313 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a9f2c4f9-dd5c-4fe2-bc75-35c4f09ad9e7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:18.760866 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a9f2c4f9-dd5c-4fe2-bc75-35c4f09ad9e7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:18.761299 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a9f2c4f9-dd5c-4fe2-bc75-35c4f09ad9e7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:18.762052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a9f2c4f9-dd5c-4fe2-bc75-35c4f09ad9e7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:18.762481 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a9f2c4f9-dd5c-4fe2-bc75-35c4f09ad9e7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:18.893756 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a9f2c4f9-dd5c-4fe2-bc75-35c4f09ad9e7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:18.901069 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a9f2c4f9-dd5c-4fe2-bc75-35c4f09ad9e7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.151091 Apr 05 11:15:18.901609 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 109/223] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:18 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:18.952518 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7a4adc66-c5e6-400a-99f8-f8709c3e3f99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:18.953144 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7a4adc66-c5e6-400a-99f8-f8709c3e3f99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:18.959157 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a4adc66-c5e6-400a-99f8-f8709c3e3f99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:18.959601 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a4adc66-c5e6-400a-99f8-f8709c3e3f99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:18.960355 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a4adc66-c5e6-400a-99f8-f8709c3e3f99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:18.960784 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a4adc66-c5e6-400a-99f8-f8709c3e3f99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:19.093409 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7a4adc66-c5e6-400a-99f8-f8709c3e3f99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:19.101239 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7a4adc66-c5e6-400a-99f8-f8709c3e3f99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.152078 Apr 05 11:15:19.101797 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 115/224] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:18 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:19.460756 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d38c238c-a1c1-4b74-b680-6938c9c7d605 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:19.461363 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d38c238c-a1c1-4b74-b680-6938c9c7d605 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:19.468049 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d38c238c-a1c1-4b74-b680-6938c9c7d605 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:19.468498 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d38c238c-a1c1-4b74-b680-6938c9c7d605 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:19.469262 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d38c238c-a1c1-4b74-b680-6938c9c7d605 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:19.469692 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d38c238c-a1c1-4b74-b680-6938c9c7d605 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:19.529312 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d38c238c-a1c1-4b74-b680-6938c9c7d605 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:19.536619 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d38c238c-a1c1-4b74-b680-6938c9c7d605 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1221 microversion: 2.1 time: 0.079873 Apr 05 11:15:19.537187 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 110/225] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:19 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:19.741062 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e8c5f4ee-6c72-43c3-b3cb-8a8e4349feca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:19.741649 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e8c5f4ee-6c72-43c3-b3cb-8a8e4349feca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:19.748298 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e8c5f4ee-6c72-43c3-b3cb-8a8e4349feca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:19.748748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e8c5f4ee-6c72-43c3-b3cb-8a8e4349feca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:19.749776 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e8c5f4ee-6c72-43c3-b3cb-8a8e4349feca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:19.750210 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e8c5f4ee-6c72-43c3-b3cb-8a8e4349feca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:19.808325 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e8c5f4ee-6c72-43c3-b3cb-8a8e4349feca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:19.815714 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e8c5f4ee-6c72-43c3-b3cb-8a8e4349feca tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1275 microversion: 2.1 time: 0.078459 Apr 05 11:15:19.816279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 116/226] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:19 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1275 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:19.920326 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-54846d17-7f33-4dd7-ba17-9a794c272ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:19.921231 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-54846d17-7f33-4dd7-ba17-9a794c272ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:19.928332 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-54846d17-7f33-4dd7-ba17-9a794c272ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:19.929606 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-54846d17-7f33-4dd7-ba17-9a794c272ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:19.930462 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-54846d17-7f33-4dd7-ba17-9a794c272ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:19.931076 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-54846d17-7f33-4dd7-ba17-9a794c272ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:20.118041 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c16fcb2b-86b7-4fc8-8df6-281098a1ba2a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:20.118812 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c16fcb2b-86b7-4fc8-8df6-281098a1ba2a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:20.125214 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c16fcb2b-86b7-4fc8-8df6-281098a1ba2a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:20.125731 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c16fcb2b-86b7-4fc8-8df6-281098a1ba2a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:20.127058 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c16fcb2b-86b7-4fc8-8df6-281098a1ba2a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:20.128004 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c16fcb2b-86b7-4fc8-8df6-281098a1ba2a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:20.297529 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-54846d17-7f33-4dd7-ba17-9a794c272ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:20.310300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-54846d17-7f33-4dd7-ba17-9a794c272ec3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.396563 Apr 05 11:15:20.312758 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 111/227] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:19 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:20.553834 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7a8d9381-fbc0-4010-855a-e37ae7a98e9b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:20.554180 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7a8d9381-fbc0-4010-855a-e37ae7a98e9b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:20.561468 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7a8d9381-fbc0-4010-855a-e37ae7a98e9b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:20.561775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7a8d9381-fbc0-4010-855a-e37ae7a98e9b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:20.575056 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7a8d9381-fbc0-4010-855a-e37ae7a98e9b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:20.575056 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7a8d9381-fbc0-4010-855a-e37ae7a98e9b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:20.604312 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c16fcb2b-86b7-4fc8-8df6-281098a1ba2a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:20.615095 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c16fcb2b-86b7-4fc8-8df6-281098a1ba2a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.501516 Apr 05 11:15:20.622091 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 117/228] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:20 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:20.632923 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7a8d9381-fbc0-4010-855a-e37ae7a98e9b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:20.640223 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7a8d9381-fbc0-4010-855a-e37ae7a98e9b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1213 microversion: 2.1 time: 0.090785 Apr 05 11:15:20.640790 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 112/229] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:20 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:20.832859 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3b5992a8-32cb-4041-8a26-d1ec2090b2a0 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:20.833475 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3b5992a8-32cb-4041-8a26-d1ec2090b2a0 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:20.841271 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3b5992a8-32cb-4041-8a26-d1ec2090b2a0 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:20.841729 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3b5992a8-32cb-4041-8a26-d1ec2090b2a0 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:20.842525 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3b5992a8-32cb-4041-8a26-d1ec2090b2a0 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:20.842992 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3b5992a8-32cb-4041-8a26-d1ec2090b2a0 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:20.906942 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3b5992a8-32cb-4041-8a26-d1ec2090b2a0 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:20.914563 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3b5992a8-32cb-4041-8a26-d1ec2090b2a0 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1273 microversion: 2.1 time: 0.085575 Apr 05 11:15:20.923968 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 118/230] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:20 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:20.983787 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-f7046a4f-a999-4b2a-bb8b-a03e80cc9bd4 req-b5b42b94-f73d-406f-bf7d-b558e991329c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f4506a-1e74-4699-938c-1fe000c3d0e7", "name": "network-vif-plugged", "status": "completed", "tag": "01522163-0d2a-4854-8bdc-d67d7aa1cd89"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:20.994080 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-f7046a4f-a999-4b2a-bb8b-a03e80cc9bd4 req-b5b42b94-f73d-406f-bf7d-b558e991329c service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:20.994743 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-f7046a4f-a999-4b2a-bb8b-a03e80cc9bd4 req-b5b42b94-f73d-406f-bf7d-b558e991329c service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:21.019717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-f7046a4f-a999-4b2a-bb8b-a03e80cc9bd4 req-b5b42b94-f73d-406f-bf7d-b558e991329c service nova] Creating event network-vif-plugged:01522163-0d2a-4854-8bdc-d67d7aa1cd89 for instance e8f4506a-1e74-4699-938c-1fe000c3d0e7 on hv-cinder-81899 Apr 05 11:15:21.040714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-f7046a4f-a999-4b2a-bb8b-a03e80cc9bd4 req-b5b42b94-f73d-406f-bf7d-b558e991329c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047851 Apr 05 11:15:21.041409 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 113/231] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:15:21.331425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-988f0351-9819-4c59-945c-8705c98f195d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:21.332123 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-988f0351-9819-4c59-945c-8705c98f195d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:21.338048 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-988f0351-9819-4c59-945c-8705c98f195d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:21.338844 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-988f0351-9819-4c59-945c-8705c98f195d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:21.339839 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-988f0351-9819-4c59-945c-8705c98f195d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:21.340499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-988f0351-9819-4c59-945c-8705c98f195d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:21.634550 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-83ffa255-7ed4-4e7a-836f-acc4a157ac87 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:21.635554 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-83ffa255-7ed4-4e7a-836f-acc4a157ac87 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:21.643560 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-83ffa255-7ed4-4e7a-836f-acc4a157ac87 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:21.644292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-83ffa255-7ed4-4e7a-836f-acc4a157ac87 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:21.645266 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-83ffa255-7ed4-4e7a-836f-acc4a157ac87 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:21.645964 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-83ffa255-7ed4-4e7a-836f-acc4a157ac87 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:21.751136 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-988f0351-9819-4c59-945c-8705c98f195d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:21.760570 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-988f0351-9819-4c59-945c-8705c98f195d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.432955 Apr 05 11:15:21.761372 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 119/232] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:21 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:21.765937 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b3c803be-5e21-4ea6-be12-ccbe072941d2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:21.766828 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b3c803be-5e21-4ea6-be12-ccbe072941d2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:21.787285 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b3c803be-5e21-4ea6-be12-ccbe072941d2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:21.787940 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b3c803be-5e21-4ea6-be12-ccbe072941d2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:21.790031 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b3c803be-5e21-4ea6-be12-ccbe072941d2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:21.790779 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b3c803be-5e21-4ea6-be12-ccbe072941d2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:21.797085 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-83ffa255-7ed4-4e7a-836f-acc4a157ac87 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:21.807767 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-83ffa255-7ed4-4e7a-836f-acc4a157ac87 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.178850 Apr 05 11:15:21.808359 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 114/233] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:21 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:21.859580 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b3c803be-5e21-4ea6-be12-ccbe072941d2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:21.867486 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b3c803be-5e21-4ea6-be12-ccbe072941d2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1269 microversion: 2.1 time: 0.104982 Apr 05 11:15:21.867999 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 120/234] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:21 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:21.932652 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b0104135-b9cf-469e-aa47-9e7e24e9b412 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:21.933290 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b0104135-b9cf-469e-aa47-9e7e24e9b412 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:21.939430 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b0104135-b9cf-469e-aa47-9e7e24e9b412 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:21.939879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b0104135-b9cf-469e-aa47-9e7e24e9b412 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:21.940644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b0104135-b9cf-469e-aa47-9e7e24e9b412 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:21.941074 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b0104135-b9cf-469e-aa47-9e7e24e9b412 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:22.077092 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b0104135-b9cf-469e-aa47-9e7e24e9b412 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:22.084484 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b0104135-b9cf-469e-aa47-9e7e24e9b412 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.156555 Apr 05 11:15:22.085644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 115/235] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:21 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:22.777885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d3f05c99-cf27-41b9-8be7-f2ba1246086d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:22.778504 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d3f05c99-cf27-41b9-8be7-f2ba1246086d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:22.784522 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3f05c99-cf27-41b9-8be7-f2ba1246086d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:22.785001 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3f05c99-cf27-41b9-8be7-f2ba1246086d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:22.785796 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3f05c99-cf27-41b9-8be7-f2ba1246086d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:22.786289 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3f05c99-cf27-41b9-8be7-f2ba1246086d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:22.824788 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9d4173ee-4c2c-4f56-8e92-a050136b79d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:22.825611 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9d4173ee-4c2c-4f56-8e92-a050136b79d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:22.832275 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d4173ee-4c2c-4f56-8e92-a050136b79d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:22.834803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d4173ee-4c2c-4f56-8e92-a050136b79d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:22.834803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d4173ee-4c2c-4f56-8e92-a050136b79d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:22.834803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d4173ee-4c2c-4f56-8e92-a050136b79d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:23.046484 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d3f05c99-cf27-41b9-8be7-f2ba1246086d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:23.080855 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d3f05c99-cf27-41b9-8be7-f2ba1246086d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.303981 Apr 05 11:15:23.081826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 121/236] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:22 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:23.095660 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e296c2b6-154f-4384-bc0c-6813d9e43cc3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:23.096898 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e296c2b6-154f-4384-bc0c-6813d9e43cc3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:23.106954 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e296c2b6-154f-4384-bc0c-6813d9e43cc3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:23.107871 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e296c2b6-154f-4384-bc0c-6813d9e43cc3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:23.108876 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e296c2b6-154f-4384-bc0c-6813d9e43cc3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:23.113407 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e296c2b6-154f-4384-bc0c-6813d9e43cc3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:23.155654 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9d4173ee-4c2c-4f56-8e92-a050136b79d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:23.166398 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9d4173ee-4c2c-4f56-8e92-a050136b79d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1314 microversion: 2.1 time: 0.345236 Apr 05 11:15:23.167028 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 116/237] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:22 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:23.172909 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9cb63f66-09d1-40f7-a434-e0ac7610e90a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:23.173775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9cb63f66-09d1-40f7-a434-e0ac7610e90a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:23.181185 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9cb63f66-09d1-40f7-a434-e0ac7610e90a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:23.181753 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9cb63f66-09d1-40f7-a434-e0ac7610e90a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:23.182791 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9cb63f66-09d1-40f7-a434-e0ac7610e90a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:23.183505 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9cb63f66-09d1-40f7-a434-e0ac7610e90a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:23.215900 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e296c2b6-154f-4384-bc0c-6813d9e43cc3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:23.224144 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e296c2b6-154f-4384-bc0c-6813d9e43cc3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1287 microversion: 2.1 time: 0.140458 Apr 05 11:15:23.224789 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 122/238] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:23 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1287 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:23.352260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9cb63f66-09d1-40f7-a434-e0ac7610e90a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:23.359507 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9cb63f66-09d1-40f7-a434-e0ac7610e90a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.190903 Apr 05 11:15:23.360073 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 117/239] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:23 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:23.423372 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-c04be841-c2f2-4f18-9094-15edfa9043fb req-3af96c7a-2169-42a0-a17c-b1e604f1d3cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf850eb7-85c7-4f51-b38a-c369acc62596", "tag": "6b821c49-a4b3-4ed6-bcb3-9b364b775da0"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:23.432175 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-c04be841-c2f2-4f18-9094-15edfa9043fb req-3af96c7a-2169-42a0-a17c-b1e604f1d3cf service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:23.432642 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-c04be841-c2f2-4f18-9094-15edfa9043fb req-3af96c7a-2169-42a0-a17c-b1e604f1d3cf service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:23.444896 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-c04be841-c2f2-4f18-9094-15edfa9043fb req-3af96c7a-2169-42a0-a17c-b1e604f1d3cf service nova] Creating event network-changed:6b821c49-a4b3-4ed6-bcb3-9b364b775da0 for instance bf850eb7-85c7-4f51-b38a-c369acc62596 on hv-cinder-81899 Apr 05 11:15:23.449948 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-c04be841-c2f2-4f18-9094-15edfa9043fb req-3af96c7a-2169-42a0-a17c-b1e604f1d3cf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030083 Apr 05 11:15:23.450551 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 123/240] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:15:24.098090 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9d60d51f-b729-466d-93ca-30ba3fca139c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:24.098729 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9d60d51f-b729-466d-93ca-30ba3fca139c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:24.105477 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d60d51f-b729-466d-93ca-30ba3fca139c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:24.105925 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d60d51f-b729-466d-93ca-30ba3fca139c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:24.106720 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d60d51f-b729-466d-93ca-30ba3fca139c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:24.107153 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d60d51f-b729-466d-93ca-30ba3fca139c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:24.183973 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3e11aad5-b397-47ce-94aa-3d47626bd149 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:24.184575 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3e11aad5-b397-47ce-94aa-3d47626bd149 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:24.190823 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3e11aad5-b397-47ce-94aa-3d47626bd149 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:24.191157 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3e11aad5-b397-47ce-94aa-3d47626bd149 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:24.191920 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3e11aad5-b397-47ce-94aa-3d47626bd149 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:24.192350 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3e11aad5-b397-47ce-94aa-3d47626bd149 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:24.245305 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9d60d51f-b729-466d-93ca-30ba3fca139c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:24.253125 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9d60d51f-b729-466d-93ca-30ba3fca139c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.158764 Apr 05 11:15:24.253714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 118/241] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:24 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:24.259089 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f1e4aa50-17ee-4641-bd84-e1aac9c401e7 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:24.259692 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f1e4aa50-17ee-4641-bd84-e1aac9c401e7 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:24.265427 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f1e4aa50-17ee-4641-bd84-e1aac9c401e7 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:24.265875 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f1e4aa50-17ee-4641-bd84-e1aac9c401e7 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:24.266635 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f1e4aa50-17ee-4641-bd84-e1aac9c401e7 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:24.267077 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f1e4aa50-17ee-4641-bd84-e1aac9c401e7 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:24.342981 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3e11aad5-b397-47ce-94aa-3d47626bd149 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:24.350396 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3e11aad5-b397-47ce-94aa-3d47626bd149 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1499 microversion: 2.1 time: 0.170648 Apr 05 11:15:24.350955 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 124/242] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:24 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1499 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:24.377272 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f7784a63-bdde-4fde-9782-ab4d5a244af8 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:24.377865 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f7784a63-bdde-4fde-9782-ab4d5a244af8 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:24.384366 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7784a63-bdde-4fde-9782-ab4d5a244af8 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:24.384807 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7784a63-bdde-4fde-9782-ab4d5a244af8 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:24.385575 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7784a63-bdde-4fde-9782-ab4d5a244af8 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:24.386000 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7784a63-bdde-4fde-9782-ab4d5a244af8 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:24.405177 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f1e4aa50-17ee-4641-bd84-e1aac9c401e7 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:24.412508 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f1e4aa50-17ee-4641-bd84-e1aac9c401e7 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.157634 Apr 05 11:15:24.413091 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 119/243] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:24 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:24.530813 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f7784a63-bdde-4fde-9782-ab4d5a244af8 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:24.538130 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f7784a63-bdde-4fde-9782-ab4d5a244af8 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.165008 Apr 05 11:15:24.538711 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 125/244] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:24 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:25.270328 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a876627c-ad48-42e1-9201-a0a976d1d9e0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:25.270891 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a876627c-ad48-42e1-9201-a0a976d1d9e0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:25.277734 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a876627c-ad48-42e1-9201-a0a976d1d9e0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:25.278169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a876627c-ad48-42e1-9201-a0a976d1d9e0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:25.278962 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a876627c-ad48-42e1-9201-a0a976d1d9e0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:25.279529 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a876627c-ad48-42e1-9201-a0a976d1d9e0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:25.416239 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a876627c-ad48-42e1-9201-a0a976d1d9e0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:25.426023 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a876627c-ad48-42e1-9201-a0a976d1d9e0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.159513 Apr 05 11:15:25.426890 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 120/245] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:25 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:25.428969 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f8662cac-bab1-40a4-9c8b-31e5f2bca109 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:25.429587 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f8662cac-bab1-40a4-9c8b-31e5f2bca109 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:25.435686 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f8662cac-bab1-40a4-9c8b-31e5f2bca109 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:25.436143 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f8662cac-bab1-40a4-9c8b-31e5f2bca109 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:25.436919 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f8662cac-bab1-40a4-9c8b-31e5f2bca109 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:25.437357 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f8662cac-bab1-40a4-9c8b-31e5f2bca109 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:25.476024 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-72a05579-8835-4d81-bebb-12af7db6196e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:25.476487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-72a05579-8835-4d81-bebb-12af7db6196e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:25.482450 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72a05579-8835-4d81-bebb-12af7db6196e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:25.482942 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72a05579-8835-4d81-bebb-12af7db6196e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:25.483722 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72a05579-8835-4d81-bebb-12af7db6196e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:25.484155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72a05579-8835-4d81-bebb-12af7db6196e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:25.508702 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-72a05579-8835-4d81-bebb-12af7db6196e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:15:25.580269 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f8662cac-bab1-40a4-9c8b-31e5f2bca109 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:25.588141 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f8662cac-bab1-40a4-9c8b-31e5f2bca109 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.162833 Apr 05 11:15:25.589279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 126/246] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:25 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:25.593024 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c5fc3b8d-6906-45da-adbf-4cdd4cf7a196 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:25.593600 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c5fc3b8d-6906-45da-adbf-4cdd4cf7a196 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:25.599082 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5fc3b8d-6906-45da-adbf-4cdd4cf7a196 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:25.599561 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5fc3b8d-6906-45da-adbf-4cdd4cf7a196 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:25.600424 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5fc3b8d-6906-45da-adbf-4cdd4cf7a196 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:25.600859 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5fc3b8d-6906-45da-adbf-4cdd4cf7a196 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:25.736784 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c5fc3b8d-6906-45da-adbf-4cdd4cf7a196 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:25.744700 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c5fc3b8d-6906-45da-adbf-4cdd4cf7a196 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.155061 Apr 05 11:15:25.745272 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 127/247] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:25 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:25.947777 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-72a05579-8835-4d81-bebb-12af7db6196e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "DELETE /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 204 len: 0 microversion: 2.1 time: 0.475431 Apr 05 11:15:25.948364 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 121/248] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:15:25 2022] DELETE /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:15:25.956357 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-224965dc-ab2b-4506-886d-eb3f13c550d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:25.956947 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-224965dc-ab2b-4506-886d-eb3f13c550d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:25.962812 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-224965dc-ab2b-4506-886d-eb3f13c550d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:25.963254 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-224965dc-ab2b-4506-886d-eb3f13c550d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:25.964035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-224965dc-ab2b-4506-886d-eb3f13c550d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:25.964467 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-224965dc-ab2b-4506-886d-eb3f13c550d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:26.097008 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-224965dc-ab2b-4506-886d-eb3f13c550d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:26.105244 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-224965dc-ab2b-4506-886d-eb3f13c550d2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1505 microversion: 2.1 time: 0.152605 Apr 05 11:15:26.105823 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 128/249] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:25 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:26.469030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f9cbc766-b98e-4cb2-8cf4-a11e57858a39 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:26.469030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f9cbc766-b98e-4cb2-8cf4-a11e57858a39 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:26.469030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9cbc766-b98e-4cb2-8cf4-a11e57858a39 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:26.469030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9cbc766-b98e-4cb2-8cf4-a11e57858a39 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:26.469931 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9cbc766-b98e-4cb2-8cf4-a11e57858a39 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:26.469931 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9cbc766-b98e-4cb2-8cf4-a11e57858a39 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:26.694117 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f9cbc766-b98e-4cb2-8cf4-a11e57858a39 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:26.694117 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f9cbc766-b98e-4cb2-8cf4-a11e57858a39 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.157881 Apr 05 11:15:26.694117 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 122/250] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:26 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:26.695025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a20b60cc-9229-4344-917e-ea3abc41c48d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:26.695025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a20b60cc-9229-4344-917e-ea3abc41c48d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:26.695025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a20b60cc-9229-4344-917e-ea3abc41c48d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:26.695025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a20b60cc-9229-4344-917e-ea3abc41c48d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:26.695838 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a20b60cc-9229-4344-917e-ea3abc41c48d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:26.695838 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a20b60cc-9229-4344-917e-ea3abc41c48d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:26.748125 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a20b60cc-9229-4344-917e-ea3abc41c48d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:26.755660 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a20b60cc-9229-4344-917e-ea3abc41c48d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.153781 Apr 05 11:15:26.756454 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 129/251] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:26 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:26.763445 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ec8c96ae-3cb1-4595-a095-ae5c9618f413 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:26.764251 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ec8c96ae-3cb1-4595-a095-ae5c9618f413 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:26.770193 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec8c96ae-3cb1-4595-a095-ae5c9618f413 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:26.776202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec8c96ae-3cb1-4595-a095-ae5c9618f413 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:26.776202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec8c96ae-3cb1-4595-a095-ae5c9618f413 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:26.776202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec8c96ae-3cb1-4595-a095-ae5c9618f413 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:26.908329 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ec8c96ae-3cb1-4595-a095-ae5c9618f413 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:26.921695 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ec8c96ae-3cb1-4595-a095-ae5c9618f413 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.162659 Apr 05 11:15:26.927533 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 123/252] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:26 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:27.123077 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7536898f-1bf7-4b56-a746-8a5c1cffc2fa tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:27.124026 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7536898f-1bf7-4b56-a746-8a5c1cffc2fa tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:27.130713 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7536898f-1bf7-4b56-a746-8a5c1cffc2fa tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:27.131167 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7536898f-1bf7-4b56-a746-8a5c1cffc2fa tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:27.132437 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7536898f-1bf7-4b56-a746-8a5c1cffc2fa tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:27.132870 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7536898f-1bf7-4b56-a746-8a5c1cffc2fa tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:27.300012 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7536898f-1bf7-4b56-a746-8a5c1cffc2fa tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:27.309187 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7536898f-1bf7-4b56-a746-8a5c1cffc2fa tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1505 microversion: 2.1 time: 0.189801 Apr 05 11:15:27.310069 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 130/253] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:27 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:27.709123 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8f893e3d-5b7a-48f3-83f9-42b1fc609e84 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:27.709823 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8f893e3d-5b7a-48f3-83f9-42b1fc609e84 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:27.716337 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f893e3d-5b7a-48f3-83f9-42b1fc609e84 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:27.716912 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f893e3d-5b7a-48f3-83f9-42b1fc609e84 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:27.717754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f893e3d-5b7a-48f3-83f9-42b1fc609e84 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:27.718272 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f893e3d-5b7a-48f3-83f9-42b1fc609e84 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:27.773442 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-39fe3ef7-e29c-42a7-a4e3-5b421f70ec18 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:27.775435 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-39fe3ef7-e29c-42a7-a4e3-5b421f70ec18 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:27.783392 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39fe3ef7-e29c-42a7-a4e3-5b421f70ec18 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:27.789863 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39fe3ef7-e29c-42a7-a4e3-5b421f70ec18 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:27.789863 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39fe3ef7-e29c-42a7-a4e3-5b421f70ec18 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:27.789863 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39fe3ef7-e29c-42a7-a4e3-5b421f70ec18 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:27.934943 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8f893e3d-5b7a-48f3-83f9-42b1fc609e84 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:27.945140 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8f893e3d-5b7a-48f3-83f9-42b1fc609e84 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.239911 Apr 05 11:15:27.950346 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 124/254] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:27 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:27.950791 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-96baa4d0-1c88-4854-a28e-09f749a69bfc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:27.951555 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-96baa4d0-1c88-4854-a28e-09f749a69bfc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:27.958822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-96baa4d0-1c88-4854-a28e-09f749a69bfc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:27.959273 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-96baa4d0-1c88-4854-a28e-09f749a69bfc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:27.960136 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-96baa4d0-1c88-4854-a28e-09f749a69bfc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:27.960579 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-96baa4d0-1c88-4854-a28e-09f749a69bfc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:28.092428 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-39fe3ef7-e29c-42a7-a4e3-5b421f70ec18 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:28.099826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-39fe3ef7-e29c-42a7-a4e3-5b421f70ec18 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.330703 Apr 05 11:15:28.104358 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 131/255] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:27 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:28.106844 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-96baa4d0-1c88-4854-a28e-09f749a69bfc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:28.114350 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-96baa4d0-1c88-4854-a28e-09f749a69bfc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.167514 Apr 05 11:15:28.114964 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 125/256] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:27 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:28.267908 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-2b9a048e-99c4-4000-bef7-beb777f827a1 req-fac94a92-c355-47d7-aa61-210d1f63c95c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33780d13-dfbe-43c6-aefe-247d419ec74d", "tag": "08ffd9a9-b769-4ccb-937e-63b57c1a883a"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:28.276377 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-2b9a048e-99c4-4000-bef7-beb777f827a1 req-fac94a92-c355-47d7-aa61-210d1f63c95c service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:28.276823 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-2b9a048e-99c4-4000-bef7-beb777f827a1 req-fac94a92-c355-47d7-aa61-210d1f63c95c service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:28.288288 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-2b9a048e-99c4-4000-bef7-beb777f827a1 req-fac94a92-c355-47d7-aa61-210d1f63c95c service nova] Creating event network-changed:08ffd9a9-b769-4ccb-937e-63b57c1a883a for instance 33780d13-dfbe-43c6-aefe-247d419ec74d on hv-cinder-81899 Apr 05 11:15:28.292900 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-2b9a048e-99c4-4000-bef7-beb777f827a1 req-fac94a92-c355-47d7-aa61-210d1f63c95c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028596 Apr 05 11:15:28.294123 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 132/257] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:15:28.326172 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-71b42a22-a4b8-41e8-8d8a-51d59a39ede6 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:28.326854 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-71b42a22-a4b8-41e8-8d8a-51d59a39ede6 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:28.332963 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71b42a22-a4b8-41e8-8d8a-51d59a39ede6 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:28.333577 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71b42a22-a4b8-41e8-8d8a-51d59a39ede6 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:28.334340 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71b42a22-a4b8-41e8-8d8a-51d59a39ede6 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:28.334897 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71b42a22-a4b8-41e8-8d8a-51d59a39ede6 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:28.469050 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-71b42a22-a4b8-41e8-8d8a-51d59a39ede6 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:28.477573 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-71b42a22-a4b8-41e8-8d8a-51d59a39ede6 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1505 microversion: 2.1 time: 0.155048 Apr 05 11:15:28.478349 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 126/258] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:28 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:28.962403 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-de1bd98d-193d-4893-9cd0-205b8960b85f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:28.963153 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-de1bd98d-193d-4893-9cd0-205b8960b85f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:28.969371 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-de1bd98d-193d-4893-9cd0-205b8960b85f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:28.969825 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-de1bd98d-193d-4893-9cd0-205b8960b85f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:28.970597 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-de1bd98d-193d-4893-9cd0-205b8960b85f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:28.971056 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-de1bd98d-193d-4893-9cd0-205b8960b85f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:29.106306 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-de1bd98d-193d-4893-9cd0-205b8960b85f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:29.114545 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-de1bd98d-193d-4893-9cd0-205b8960b85f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.156344 Apr 05 11:15:29.115156 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 133/259] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:28 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:29.120243 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0cf05544-8886-485e-9741-11fe7e3e6e0f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:29.120859 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0cf05544-8886-485e-9741-11fe7e3e6e0f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:29.128478 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0cf05544-8886-485e-9741-11fe7e3e6e0f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:29.128966 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0cf05544-8886-485e-9741-11fe7e3e6e0f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:29.129856 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0cf05544-8886-485e-9741-11fe7e3e6e0f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:29.130309 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0cf05544-8886-485e-9741-11fe7e3e6e0f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:29.132979 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-458db590-68a3-4a3d-a777-5f0048de1a34 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:29.133579 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-458db590-68a3-4a3d-a777-5f0048de1a34 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:29.139420 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-458db590-68a3-4a3d-a777-5f0048de1a34 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:29.139921 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-458db590-68a3-4a3d-a777-5f0048de1a34 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:29.140695 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-458db590-68a3-4a3d-a777-5f0048de1a34 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:29.141122 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-458db590-68a3-4a3d-a777-5f0048de1a34 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:29.273115 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0cf05544-8886-485e-9741-11fe7e3e6e0f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:29.276066 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-458db590-68a3-4a3d-a777-5f0048de1a34 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:29.287311 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-458db590-68a3-4a3d-a777-5f0048de1a34 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.157584 Apr 05 11:15:29.293067 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 134/260] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:29 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:29.294363 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0cf05544-8886-485e-9741-11fe7e3e6e0f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.178170 Apr 05 11:15:29.295536 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 127/261] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:29 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:29.497288 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5e35eeb9-6017-4475-a22f-b935e1af399a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:29.498095 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5e35eeb9-6017-4475-a22f-b935e1af399a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:29.505013 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e35eeb9-6017-4475-a22f-b935e1af399a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:29.505459 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e35eeb9-6017-4475-a22f-b935e1af399a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:29.506235 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e35eeb9-6017-4475-a22f-b935e1af399a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:29.506787 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e35eeb9-6017-4475-a22f-b935e1af399a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:29.661325 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5e35eeb9-6017-4475-a22f-b935e1af399a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:29.664885 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-efbc0200-ebce-425a-88d5-95556a2e1a21 req-4d8691e4-e641-43d5-8659-a3b18cf2a14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b89d15-5832-49f1-936c-f8219d65c62b", "name": "network-vif-plugged", "status": "completed", "tag": "df7c1568-9880-4e21-856e-00b35d9664cd"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:29.671076 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5e35eeb9-6017-4475-a22f-b935e1af399a tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1505 microversion: 2.1 time: 0.177962 Apr 05 11:15:29.671674 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 135/262] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:29 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:29.677847 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-efbc0200-ebce-425a-88d5-95556a2e1a21 req-4d8691e4-e641-43d5-8659-a3b18cf2a14d service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:29.683518 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-efbc0200-ebce-425a-88d5-95556a2e1a21 req-4d8691e4-e641-43d5-8659-a3b18cf2a14d service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:29.694674 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-efbc0200-ebce-425a-88d5-95556a2e1a21 req-4d8691e4-e641-43d5-8659-a3b18cf2a14d service nova] Creating event network-vif-plugged:df7c1568-9880-4e21-856e-00b35d9664cd for instance 31b89d15-5832-49f1-936c-f8219d65c62b on hv-cinder-81899 Apr 05 11:15:29.699527 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-efbc0200-ebce-425a-88d5-95556a2e1a21 req-4d8691e4-e641-43d5-8659-a3b18cf2a14d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039874 Apr 05 11:15:29.700124 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 128/263] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:15:30.133814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-34d23142-1c06-49dc-baaa-b379747bf6c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:30.134417 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-34d23142-1c06-49dc-baaa-b379747bf6c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:30.140459 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34d23142-1c06-49dc-baaa-b379747bf6c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:30.140900 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34d23142-1c06-49dc-baaa-b379747bf6c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:30.141657 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34d23142-1c06-49dc-baaa-b379747bf6c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:30.142083 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34d23142-1c06-49dc-baaa-b379747bf6c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:30.278480 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-34d23142-1c06-49dc-baaa-b379747bf6c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:30.286593 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-34d23142-1c06-49dc-baaa-b379747bf6c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.157061 Apr 05 11:15:30.287485 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 136/264] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:30 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:30.311104 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ad22f81b-2c4d-406d-aae0-d6576af236fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:30.311810 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ad22f81b-2c4d-406d-aae0-d6576af236fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:30.312908 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-22e17bc4-e3d0-4ce6-8bae-3fe9dbba9d5c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:30.313615 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-22e17bc4-e3d0-4ce6-8bae-3fe9dbba9d5c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:30.318404 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad22f81b-2c4d-406d-aae0-d6576af236fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:30.318891 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad22f81b-2c4d-406d-aae0-d6576af236fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:30.320327 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad22f81b-2c4d-406d-aae0-d6576af236fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:30.320526 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-22e17bc4-e3d0-4ce6-8bae-3fe9dbba9d5c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:30.320756 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad22f81b-2c4d-406d-aae0-d6576af236fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:30.320973 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-22e17bc4-e3d0-4ce6-8bae-3fe9dbba9d5c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:30.322044 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-22e17bc4-e3d0-4ce6-8bae-3fe9dbba9d5c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:30.322552 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-22e17bc4-e3d0-4ce6-8bae-3fe9dbba9d5c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:30.471004 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ad22f81b-2c4d-406d-aae0-d6576af236fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:30.478665 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ad22f81b-2c4d-406d-aae0-d6576af236fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.172536 Apr 05 11:15:30.479252 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 129/265] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:30 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:30.486585 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-22e17bc4-e3d0-4ce6-8bae-3fe9dbba9d5c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:30.494523 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-22e17bc4-e3d0-4ce6-8bae-3fe9dbba9d5c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.186610 Apr 05 11:15:30.495130 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 137/266] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:30 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:30.690248 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bc96abb0-8a22-402f-bab5-0df2ba458afc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:30.690905 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bc96abb0-8a22-402f-bab5-0df2ba458afc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:30.697140 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bc96abb0-8a22-402f-bab5-0df2ba458afc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:30.697634 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bc96abb0-8a22-402f-bab5-0df2ba458afc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:30.698416 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bc96abb0-8a22-402f-bab5-0df2ba458afc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:30.698876 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bc96abb0-8a22-402f-bab5-0df2ba458afc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:30.904992 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bc96abb0-8a22-402f-bab5-0df2ba458afc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:30.913669 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bc96abb0-8a22-402f-bab5-0df2ba458afc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1505 microversion: 2.1 time: 0.226698 Apr 05 11:15:30.914266 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 130/267] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:30 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:31.303621 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fdcbdd3e-eee4-4fdc-b27a-9d637f9ad278 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:31.304334 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fdcbdd3e-eee4-4fdc-b27a-9d637f9ad278 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:31.311884 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fdcbdd3e-eee4-4fdc-b27a-9d637f9ad278 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:31.313781 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fdcbdd3e-eee4-4fdc-b27a-9d637f9ad278 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:31.314885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fdcbdd3e-eee4-4fdc-b27a-9d637f9ad278 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:31.327718 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fdcbdd3e-eee4-4fdc-b27a-9d637f9ad278 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:31.495867 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b266e804-44ef-4123-95a4-f8feb3762447 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:31.496482 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b266e804-44ef-4123-95a4-f8feb3762447 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:31.503155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b266e804-44ef-4123-95a4-f8feb3762447 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:31.503569 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b266e804-44ef-4123-95a4-f8feb3762447 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:31.504392 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b266e804-44ef-4123-95a4-f8feb3762447 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:31.504787 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b266e804-44ef-4123-95a4-f8feb3762447 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:31.572103 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fdcbdd3e-eee4-4fdc-b27a-9d637f9ad278 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:31.580799 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fdcbdd3e-eee4-4fdc-b27a-9d637f9ad278 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.281197 Apr 05 11:15:31.581833 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 138/268] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:31 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:31.587611 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7a32414f-8994-4ed6-a889-4e3690a96001 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:31.588688 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7a32414f-8994-4ed6-a889-4e3690a96001 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:31.595583 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a32414f-8994-4ed6-a889-4e3690a96001 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:31.596224 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a32414f-8994-4ed6-a889-4e3690a96001 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:31.597182 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a32414f-8994-4ed6-a889-4e3690a96001 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:31.597768 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a32414f-8994-4ed6-a889-4e3690a96001 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:31.644353 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b266e804-44ef-4123-95a4-f8feb3762447 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:31.653481 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b266e804-44ef-4123-95a4-f8feb3762447 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.161273 Apr 05 11:15:31.654155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 131/269] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:31 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:31.858148 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7a32414f-8994-4ed6-a889-4e3690a96001 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:31.866434 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7a32414f-8994-4ed6-a889-4e3690a96001 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.282542 Apr 05 11:15:31.876613 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 139/270] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:31 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:31.931509 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-84161fd3-08bf-4b7c-b769-463059c50000 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:31.932240 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-84161fd3-08bf-4b7c-b769-463059c50000 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:31.938218 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84161fd3-08bf-4b7c-b769-463059c50000 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:31.938688 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84161fd3-08bf-4b7c-b769-463059c50000 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:31.939485 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84161fd3-08bf-4b7c-b769-463059c50000 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:31.940066 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84161fd3-08bf-4b7c-b769-463059c50000 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:32.019260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-84161fd3-08bf-4b7c-b769-463059c50000 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:32.034334 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-84161fd3-08bf-4b7c-b769-463059c50000 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1463 microversion: 2.1 time: 0.107168 Apr 05 11:15:32.035514 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 132/271] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:31 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1463 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:32.099165 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-582809fb-b000-4236-a20c-5ef9e44c77a1 req-84ead7ca-7a87-4169-88d6-259c620de232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f4141f-bac2-4e5c-9171-881df70931e8", "name": "network-vif-deleted", "tag": "0747daec-ec58-48af-85b4-85470275e1a5"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:32.107773 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-582809fb-b000-4236-a20c-5ef9e44c77a1 req-84ead7ca-7a87-4169-88d6-259c620de232 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:32.108646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-582809fb-b000-4236-a20c-5ef9e44c77a1 req-84ead7ca-7a87-4169-88d6-259c620de232 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:32.119815 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-582809fb-b000-4236-a20c-5ef9e44c77a1 req-84ead7ca-7a87-4169-88d6-259c620de232 service nova] Creating event network-vif-deleted:0747daec-ec58-48af-85b4-85470275e1a5 for instance 37f4141f-bac2-4e5c-9171-881df70931e8 on hv-cinder-81899 Apr 05 11:15:32.124900 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-582809fb-b000-4236-a20c-5ef9e44c77a1 req-84ead7ca-7a87-4169-88d6-259c620de232 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029381 Apr 05 11:15:32.125839 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 140/272] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:15:32.598513 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-93fba2ad-3909-4968-b078-467e6eef9821 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:32.599081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-93fba2ad-3909-4968-b078-467e6eef9821 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:32.606045 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93fba2ad-3909-4968-b078-467e6eef9821 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:32.606485 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93fba2ad-3909-4968-b078-467e6eef9821 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:32.607270 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93fba2ad-3909-4968-b078-467e6eef9821 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:32.607699 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93fba2ad-3909-4968-b078-467e6eef9821 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:32.670729 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-719b2c32-7431-417b-8423-1a95dbd22c56 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:32.671418 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-719b2c32-7431-417b-8423-1a95dbd22c56 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:32.677738 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-719b2c32-7431-417b-8423-1a95dbd22c56 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:32.678185 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-719b2c32-7431-417b-8423-1a95dbd22c56 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:32.679013 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-719b2c32-7431-417b-8423-1a95dbd22c56 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:32.679444 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-719b2c32-7431-417b-8423-1a95dbd22c56 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:32.746688 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-93fba2ad-3909-4968-b078-467e6eef9821 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:32.755834 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-93fba2ad-3909-4968-b078-467e6eef9821 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.161078 Apr 05 11:15:32.756640 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 133/273] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:32 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:32.828369 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-719b2c32-7431-417b-8423-1a95dbd22c56 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:32.836224 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-719b2c32-7431-417b-8423-1a95dbd22c56 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.169663 Apr 05 11:15:32.836795 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 141/274] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:32 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:32.884810 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d872430e-1ef1-45cc-952f-62c4aac15974 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:32.885325 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d872430e-1ef1-45cc-952f-62c4aac15974 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:32.891949 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d872430e-1ef1-45cc-952f-62c4aac15974 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:32.892394 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d872430e-1ef1-45cc-952f-62c4aac15974 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:32.893234 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d872430e-1ef1-45cc-952f-62c4aac15974 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:32.893667 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d872430e-1ef1-45cc-952f-62c4aac15974 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:33.036495 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d872430e-1ef1-45cc-952f-62c4aac15974 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:33.044085 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d872430e-1ef1-45cc-952f-62c4aac15974 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.163962 Apr 05 11:15:33.044662 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 134/275] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:32 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:33.051875 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-aae61f3c-36f7-4595-b688-c38ce48e1ef3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:33.052485 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-aae61f3c-36f7-4595-b688-c38ce48e1ef3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:33.058519 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aae61f3c-36f7-4595-b688-c38ce48e1ef3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:33.059216 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aae61f3c-36f7-4595-b688-c38ce48e1ef3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:33.060054 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aae61f3c-36f7-4595-b688-c38ce48e1ef3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:33.060495 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aae61f3c-36f7-4595-b688-c38ce48e1ef3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:33.125006 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-aae61f3c-36f7-4595-b688-c38ce48e1ef3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:33.133262 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-aae61f3c-36f7-4595-b688-c38ce48e1ef3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1299 microversion: 2.1 time: 0.085155 Apr 05 11:15:33.133840 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 142/276] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:33 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:33.772875 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3e478b2f-72a2-43d9-93ec-eb1c862d0b59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:33.773551 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3e478b2f-72a2-43d9-93ec-eb1c862d0b59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:33.780120 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e478b2f-72a2-43d9-93ec-eb1c862d0b59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:33.780567 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e478b2f-72a2-43d9-93ec-eb1c862d0b59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:33.781335 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e478b2f-72a2-43d9-93ec-eb1c862d0b59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:33.781789 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e478b2f-72a2-43d9-93ec-eb1c862d0b59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:33.853997 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a7bd2d57-7a80-4601-9478-bc3832768727 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:33.854627 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a7bd2d57-7a80-4601-9478-bc3832768727 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:33.860752 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7bd2d57-7a80-4601-9478-bc3832768727 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:33.861347 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7bd2d57-7a80-4601-9478-bc3832768727 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:33.862128 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7bd2d57-7a80-4601-9478-bc3832768727 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:33.862559 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7bd2d57-7a80-4601-9478-bc3832768727 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:33.924614 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3e478b2f-72a2-43d9-93ec-eb1c862d0b59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:33.932670 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3e478b2f-72a2-43d9-93ec-eb1c862d0b59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.163594 Apr 05 11:15:33.933394 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 135/277] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:33 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:34.014383 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a7bd2d57-7a80-4601-9478-bc3832768727 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:34.021766 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a7bd2d57-7a80-4601-9478-bc3832768727 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.172346 Apr 05 11:15:34.023029 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 143/278] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:33 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:34.061478 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-75efd421-c572-4982-9290-73adfb052951 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:34.062080 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-75efd421-c572-4982-9290-73adfb052951 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:34.068054 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-75efd421-c572-4982-9290-73adfb052951 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:34.068496 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-75efd421-c572-4982-9290-73adfb052951 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:34.069288 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-75efd421-c572-4982-9290-73adfb052951 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:34.069723 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-75efd421-c572-4982-9290-73adfb052951 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:34.149332 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dd243786-5224-4380-8d69-b6e10c4421ed tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:34.150030 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dd243786-5224-4380-8d69-b6e10c4421ed tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:34.156388 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dd243786-5224-4380-8d69-b6e10c4421ed tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:34.156842 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dd243786-5224-4380-8d69-b6e10c4421ed tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:34.157670 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dd243786-5224-4380-8d69-b6e10c4421ed tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:34.158100 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dd243786-5224-4380-8d69-b6e10c4421ed tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:34.219438 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-75efd421-c572-4982-9290-73adfb052951 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:34.223075 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dd243786-5224-4380-8d69-b6e10c4421ed tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:34.227177 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-75efd421-c572-4982-9290-73adfb052951 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.169419 Apr 05 11:15:34.227760 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 136/279] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:34 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:34.230904 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dd243786-5224-4380-8d69-b6e10c4421ed tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1299 microversion: 2.1 time: 0.085368 Apr 05 11:15:34.231688 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 144/280] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:34 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:34.949364 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b409dd38-ce96-4959-ae74-d76ea7ba8b29 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:34.949963 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b409dd38-ce96-4959-ae74-d76ea7ba8b29 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:34.956320 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b409dd38-ce96-4959-ae74-d76ea7ba8b29 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:34.956822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b409dd38-ce96-4959-ae74-d76ea7ba8b29 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:34.957587 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b409dd38-ce96-4959-ae74-d76ea7ba8b29 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:34.958013 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b409dd38-ce96-4959-ae74-d76ea7ba8b29 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:35.040481 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e1a42dc9-f8d8-4e0b-8ebe-ea10ef6bbb55 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:35.041418 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e1a42dc9-f8d8-4e0b-8ebe-ea10ef6bbb55 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:35.047510 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e1a42dc9-f8d8-4e0b-8ebe-ea10ef6bbb55 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:35.047860 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e1a42dc9-f8d8-4e0b-8ebe-ea10ef6bbb55 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:35.048755 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e1a42dc9-f8d8-4e0b-8ebe-ea10ef6bbb55 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:35.049409 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e1a42dc9-f8d8-4e0b-8ebe-ea10ef6bbb55 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:35.132879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b409dd38-ce96-4959-ae74-d76ea7ba8b29 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:35.140330 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b409dd38-ce96-4959-ae74-d76ea7ba8b29 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.194718 Apr 05 11:15:35.141024 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 137/281] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:34 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:35.200175 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e1a42dc9-f8d8-4e0b-8ebe-ea10ef6bbb55 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:35.207605 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e1a42dc9-f8d8-4e0b-8ebe-ea10ef6bbb55 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.171630 Apr 05 11:15:35.208187 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 145/282] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:35 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:35.244785 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ec6b60f9-deec-4f41-b1a8-5776bb2d7f65 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:35.245394 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ec6b60f9-deec-4f41-b1a8-5776bb2d7f65 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:35.247806 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5413e02a-ed1b-45c2-97e2-74024826a749 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:35.248712 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5413e02a-ed1b-45c2-97e2-74024826a749 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:35.252068 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec6b60f9-deec-4f41-b1a8-5776bb2d7f65 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:35.252519 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec6b60f9-deec-4f41-b1a8-5776bb2d7f65 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:35.253306 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec6b60f9-deec-4f41-b1a8-5776bb2d7f65 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:35.253890 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec6b60f9-deec-4f41-b1a8-5776bb2d7f65 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:35.254853 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5413e02a-ed1b-45c2-97e2-74024826a749 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:35.255307 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5413e02a-ed1b-45c2-97e2-74024826a749 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:35.256087 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5413e02a-ed1b-45c2-97e2-74024826a749 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:35.256524 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5413e02a-ed1b-45c2-97e2-74024826a749 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:35.324356 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5413e02a-ed1b-45c2-97e2-74024826a749 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:35.332310 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5413e02a-ed1b-45c2-97e2-74024826a749 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1299 microversion: 2.1 time: 0.087764 Apr 05 11:15:35.333448 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 146/283] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:35 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:35.399432 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ec6b60f9-deec-4f41-b1a8-5776bb2d7f65 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:35.406836 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ec6b60f9-deec-4f41-b1a8-5776bb2d7f65 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.166402 Apr 05 11:15:35.407440 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 138/284] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:35 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:36.157622 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a6c1009a-1bba-48f1-b806-0030837a2c19 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:36.158262 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a6c1009a-1bba-48f1-b806-0030837a2c19 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:36.164211 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6c1009a-1bba-48f1-b806-0030837a2c19 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:36.164662 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6c1009a-1bba-48f1-b806-0030837a2c19 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:36.165432 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6c1009a-1bba-48f1-b806-0030837a2c19 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:36.165869 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6c1009a-1bba-48f1-b806-0030837a2c19 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:36.225031 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2c076dd2-60ca-45d1-8d87-37ad0f400f7a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:36.225712 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2c076dd2-60ca-45d1-8d87-37ad0f400f7a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:36.232228 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2c076dd2-60ca-45d1-8d87-37ad0f400f7a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:36.232666 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2c076dd2-60ca-45d1-8d87-37ad0f400f7a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:36.233441 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2c076dd2-60ca-45d1-8d87-37ad0f400f7a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:36.233878 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2c076dd2-60ca-45d1-8d87-37ad0f400f7a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:36.306329 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a6c1009a-1bba-48f1-b806-0030837a2c19 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:36.313798 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a6c1009a-1bba-48f1-b806-0030837a2c19 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.159976 Apr 05 11:15:36.322498 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 147/285] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:36 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:36.349323 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3d71c31c-fbd6-45ca-8954-7017bf4fd344 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:36.349849 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3d71c31c-fbd6-45ca-8954-7017bf4fd344 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:36.356281 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d71c31c-fbd6-45ca-8954-7017bf4fd344 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:36.356731 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d71c31c-fbd6-45ca-8954-7017bf4fd344 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:36.357510 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d71c31c-fbd6-45ca-8954-7017bf4fd344 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:36.357948 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d71c31c-fbd6-45ca-8954-7017bf4fd344 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:36.372714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2c076dd2-60ca-45d1-8d87-37ad0f400f7a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:36.380292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2c076dd2-60ca-45d1-8d87-37ad0f400f7a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.159165 Apr 05 11:15:36.380870 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 139/286] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:36 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:36.424282 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3d71c31c-fbd6-45ca-8954-7017bf4fd344 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:36.424472 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-634add57-2c33-4d28-a006-62e7b58176a4 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:36.425932 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-634add57-2c33-4d28-a006-62e7b58176a4 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:36.432122 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-634add57-2c33-4d28-a006-62e7b58176a4 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:36.432476 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3d71c31c-fbd6-45ca-8954-7017bf4fd344 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1299 microversion: 2.1 time: 0.087007 Apr 05 11:15:36.432650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-634add57-2c33-4d28-a006-62e7b58176a4 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:36.433058 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 148/287] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:36 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:36.433473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-634add57-2c33-4d28-a006-62e7b58176a4 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:36.433957 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-634add57-2c33-4d28-a006-62e7b58176a4 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:36.568687 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-634add57-2c33-4d28-a006-62e7b58176a4 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:36.576138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-634add57-2c33-4d28-a006-62e7b58176a4 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.155620 Apr 05 11:15:36.576714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 140/288] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:36 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:37.333116 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1f90bf49-3cd1-487e-b232-171034d3f17d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:37.333950 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1f90bf49-3cd1-487e-b232-171034d3f17d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:37.340762 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1f90bf49-3cd1-487e-b232-171034d3f17d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:37.341310 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1f90bf49-3cd1-487e-b232-171034d3f17d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:37.342152 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1f90bf49-3cd1-487e-b232-171034d3f17d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:37.342684 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1f90bf49-3cd1-487e-b232-171034d3f17d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:37.396926 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fbd7f08e-7263-431a-bb8a-e9674207bafc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:37.398133 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fbd7f08e-7263-431a-bb8a-e9674207bafc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:37.404586 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fbd7f08e-7263-431a-bb8a-e9674207bafc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:37.405043 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fbd7f08e-7263-431a-bb8a-e9674207bafc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:37.405811 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fbd7f08e-7263-431a-bb8a-e9674207bafc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:37.406407 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fbd7f08e-7263-431a-bb8a-e9674207bafc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:37.497881 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1f90bf49-3cd1-487e-b232-171034d3f17d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:37.506122 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1f90bf49-3cd1-487e-b232-171034d3f17d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.178002 Apr 05 11:15:37.507439 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 149/289] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:37 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:37.515278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-84740fe5-f3fd-4773-bf7e-72156c447c07 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:37.515278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-84740fe5-f3fd-4773-bf7e-72156c447c07 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:37.518758 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-84740fe5-f3fd-4773-bf7e-72156c447c07 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:37.519278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-84740fe5-f3fd-4773-bf7e-72156c447c07 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:37.520116 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-84740fe5-f3fd-4773-bf7e-72156c447c07 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:37.520620 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-84740fe5-f3fd-4773-bf7e-72156c447c07 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:37.568725 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fbd7f08e-7263-431a-bb8a-e9674207bafc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:37.576764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fbd7f08e-7263-431a-bb8a-e9674207bafc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.183744 Apr 05 11:15:37.577510 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 141/290] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:37 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:37.582157 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-84740fe5-f3fd-4773-bf7e-72156c447c07 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:37.589558 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-84740fe5-f3fd-4773-bf7e-72156c447c07 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1299 microversion: 2.1 time: 0.081144 Apr 05 11:15:37.590126 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 150/291] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:37 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1299 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:37.593417 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-59acd192-dc31-49ee-a00d-10a2fe53574f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:37.594063 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-59acd192-dc31-49ee-a00d-10a2fe53574f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:37.600281 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59acd192-dc31-49ee-a00d-10a2fe53574f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:37.600733 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59acd192-dc31-49ee-a00d-10a2fe53574f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:37.601511 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59acd192-dc31-49ee-a00d-10a2fe53574f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:37.601951 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59acd192-dc31-49ee-a00d-10a2fe53574f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:37.739387 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-59acd192-dc31-49ee-a00d-10a2fe53574f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:37.747242 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-59acd192-dc31-49ee-a00d-10a2fe53574f tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.157840 Apr 05 11:15:37.747813 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 142/292] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:37 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:38.526279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0df6ef8b-183f-4e43-bdf5-60b3a65b44dc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:38.527295 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0df6ef8b-183f-4e43-bdf5-60b3a65b44dc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:38.534102 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0df6ef8b-183f-4e43-bdf5-60b3a65b44dc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:38.534695 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0df6ef8b-183f-4e43-bdf5-60b3a65b44dc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:38.535483 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0df6ef8b-183f-4e43-bdf5-60b3a65b44dc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:38.535910 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0df6ef8b-183f-4e43-bdf5-60b3a65b44dc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:38.593420 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9400b41c-7083-4aa9-97eb-4b4aed0a6d5e tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:38.594023 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9400b41c-7083-4aa9-97eb-4b4aed0a6d5e tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:38.601274 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9400b41c-7083-4aa9-97eb-4b4aed0a6d5e tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:38.601718 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9400b41c-7083-4aa9-97eb-4b4aed0a6d5e tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:38.602788 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9400b41c-7083-4aa9-97eb-4b4aed0a6d5e tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:38.603224 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9400b41c-7083-4aa9-97eb-4b4aed0a6d5e tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:38.687045 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0df6ef8b-183f-4e43-bdf5-60b3a65b44dc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:38.698870 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0df6ef8b-183f-4e43-bdf5-60b3a65b44dc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.176461 Apr 05 11:15:38.700078 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 151/293] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:38 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:38.708217 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d59691b0-aaaa-4f6d-906f-1d227684ceca tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:38.709535 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d59691b0-aaaa-4f6d-906f-1d227684ceca tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:38.719184 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d59691b0-aaaa-4f6d-906f-1d227684ceca tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:38.720156 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d59691b0-aaaa-4f6d-906f-1d227684ceca tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:38.721527 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d59691b0-aaaa-4f6d-906f-1d227684ceca tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:38.722316 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d59691b0-aaaa-4f6d-906f-1d227684ceca tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:38.750635 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9400b41c-7083-4aa9-97eb-4b4aed0a6d5e tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:38.757981 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9400b41c-7083-4aa9-97eb-4b4aed0a6d5e tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.168435 Apr 05 11:15:38.759960 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 143/294] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:38 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:38.764748 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d2a0495f-0ef7-4d14-9a1b-18154f29bb29 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:38.765355 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d2a0495f-0ef7-4d14-9a1b-18154f29bb29 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:38.772286 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2a0495f-0ef7-4d14-9a1b-18154f29bb29 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:38.772738 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2a0495f-0ef7-4d14-9a1b-18154f29bb29 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:38.773511 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2a0495f-0ef7-4d14-9a1b-18154f29bb29 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:38.773949 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2a0495f-0ef7-4d14-9a1b-18154f29bb29 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:38.809701 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d59691b0-aaaa-4f6d-906f-1d227684ceca tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:38.817792 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d59691b0-aaaa-4f6d-906f-1d227684ceca tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1299 microversion: 2.1 time: 0.116309 Apr 05 11:15:38.818377 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 152/295] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:38 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:38.911146 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d2a0495f-0ef7-4d14-9a1b-18154f29bb29 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:38.922015 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d2a0495f-0ef7-4d14-9a1b-18154f29bb29 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.160923 Apr 05 11:15:38.922650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 144/296] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:38 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:39.716427 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9d4aa438-c435-4a13-be92-fc218670d5c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:39.717157 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9d4aa438-c435-4a13-be92-fc218670d5c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:39.723326 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9d4aa438-c435-4a13-be92-fc218670d5c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:39.723775 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9d4aa438-c435-4a13-be92-fc218670d5c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:39.724552 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9d4aa438-c435-4a13-be92-fc218670d5c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:39.724985 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9d4aa438-c435-4a13-be92-fc218670d5c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:39.775759 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-31c4447a-77e4-4aee-9188-630b29e6bb8b tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:39.776362 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-31c4447a-77e4-4aee-9188-630b29e6bb8b tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:39.783302 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-31c4447a-77e4-4aee-9188-630b29e6bb8b tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:39.783784 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-31c4447a-77e4-4aee-9188-630b29e6bb8b tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:39.784739 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-31c4447a-77e4-4aee-9188-630b29e6bb8b tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:39.785160 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-31c4447a-77e4-4aee-9188-630b29e6bb8b tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:39.874530 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9d4aa438-c435-4a13-be92-fc218670d5c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:39.884594 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9d4aa438-c435-4a13-be92-fc218670d5c6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1321 microversion: 2.1 time: 0.170437 Apr 05 11:15:39.884594 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 153/297] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:39 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:39.889183 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bd062388-ae88-42ea-9878-e61aa9b563f2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:39.889945 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bd062388-ae88-42ea-9878-e61aa9b563f2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:39.897519 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bd062388-ae88-42ea-9878-e61aa9b563f2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:39.898284 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bd062388-ae88-42ea-9878-e61aa9b563f2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:39.899341 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bd062388-ae88-42ea-9878-e61aa9b563f2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:39.899826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bd062388-ae88-42ea-9878-e61aa9b563f2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:39.930472 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bd062388-ae88-42ea-9878-e61aa9b563f2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:39.930939 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bd062388-ae88-42ea-9878-e61aa9b563f2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:39.931396 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-bd062388-ae88-42ea-9878-e61aa9b563f2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lazy-loading 'fault' on Instance uuid 37f4141f-bac2-4e5c-9171-881df70931e8 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:15:39.932639 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-31c4447a-77e4-4aee-9188-630b29e6bb8b tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:39.940458 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-31c4447a-77e4-4aee-9188-630b29e6bb8b tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.168684 Apr 05 11:15:39.941821 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 145/298] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:39 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:39.946274 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1af19307-4519-40be-a1cc-bb4fa526bfd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:39.946899 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1af19307-4519-40be-a1cc-bb4fa526bfd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:39.952678 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1af19307-4519-40be-a1cc-bb4fa526bfd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:39.953115 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1af19307-4519-40be-a1cc-bb4fa526bfd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:39.953877 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1af19307-4519-40be-a1cc-bb4fa526bfd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:39.954305 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1af19307-4519-40be-a1cc-bb4fa526bfd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:39.974034 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bd062388-ae88-42ea-9878-e61aa9b563f2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:39.981529 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bd062388-ae88-42ea-9878-e61aa9b563f2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1304 microversion: 2.1 time: 0.096575 Apr 05 11:15:39.982150 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 154/299] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:39 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:40.103882 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1af19307-4519-40be-a1cc-bb4fa526bfd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:40.111876 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1af19307-4519-40be-a1cc-bb4fa526bfd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.169800 Apr 05 11:15:40.112475 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 146/300] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:39 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:40.128932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-af6a350e-d057-472d-ac8b-8b19bb55299f req-52c30fa2-9c5f-44b8-84b3-bfbd4d76c3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33780d13-dfbe-43c6-aefe-247d419ec74d", "name": "network-vif-plugged", "status": "completed", "tag": "08ffd9a9-b769-4ccb-937e-63b57c1a883a"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:40.137009 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-af6a350e-d057-472d-ac8b-8b19bb55299f req-52c30fa2-9c5f-44b8-84b3-bfbd4d76c3a9 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:40.138173 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-af6a350e-d057-472d-ac8b-8b19bb55299f req-52c30fa2-9c5f-44b8-84b3-bfbd4d76c3a9 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:40.150070 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-af6a350e-d057-472d-ac8b-8b19bb55299f req-52c30fa2-9c5f-44b8-84b3-bfbd4d76c3a9 service nova] Creating event network-vif-plugged:08ffd9a9-b769-4ccb-937e-63b57c1a883a for instance 33780d13-dfbe-43c6-aefe-247d419ec74d on hv-cinder-81899 Apr 05 11:15:40.155561 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-af6a350e-d057-472d-ac8b-8b19bb55299f req-52c30fa2-9c5f-44b8-84b3-bfbd4d76c3a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031170 Apr 05 11:15:40.156333 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 155/301] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:15:40.900678 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-81188c31-d194-41fc-ab6f-2441bdca395b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:40.905532 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-81188c31-d194-41fc-ab6f-2441bdca395b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:40.907723 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81188c31-d194-41fc-ab6f-2441bdca395b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:40.908172 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81188c31-d194-41fc-ab6f-2441bdca395b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:40.908936 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81188c31-d194-41fc-ab6f-2441bdca395b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:40.909365 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81188c31-d194-41fc-ab6f-2441bdca395b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:40.958165 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-316cf62d-abb1-416b-a8b6-4e24e5de76fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:40.958888 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-316cf62d-abb1-416b-a8b6-4e24e5de76fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:40.965769 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-316cf62d-abb1-416b-a8b6-4e24e5de76fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:40.966226 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-316cf62d-abb1-416b-a8b6-4e24e5de76fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:40.967155 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-316cf62d-abb1-416b-a8b6-4e24e5de76fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:40.967631 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-316cf62d-abb1-416b-a8b6-4e24e5de76fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:41.050119 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-81188c31-d194-41fc-ab6f-2441bdca395b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:41.058197 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-81188c31-d194-41fc-ab6f-2441bdca395b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1514 microversion: 2.1 time: 0.161958 Apr 05 11:15:41.058838 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 147/302] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:40 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:41.063559 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-13963e57-4e3a-4e8a-b18c-7474bac78276 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:41.064209 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-13963e57-4e3a-4e8a-b18c-7474bac78276 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:41.071216 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13963e57-4e3a-4e8a-b18c-7474bac78276 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:41.071681 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13963e57-4e3a-4e8a-b18c-7474bac78276 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:41.072455 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13963e57-4e3a-4e8a-b18c-7474bac78276 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:41.072892 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13963e57-4e3a-4e8a-b18c-7474bac78276 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:41.106413 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13963e57-4e3a-4e8a-b18c-7474bac78276 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:41.106951 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13963e57-4e3a-4e8a-b18c-7474bac78276 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:41.107449 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-13963e57-4e3a-4e8a-b18c-7474bac78276 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lazy-loading 'fault' on Instance uuid 37f4141f-bac2-4e5c-9171-881df70931e8 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:15:41.110833 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-316cf62d-abb1-416b-a8b6-4e24e5de76fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:41.118450 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-316cf62d-abb1-416b-a8b6-4e24e5de76fd tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.164705 Apr 05 11:15:41.119180 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 156/303] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:40 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:41.124518 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-559845dc-cfc6-447d-8e6d-9d8c56c4ca34 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:41.125488 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-559845dc-cfc6-447d-8e6d-9d8c56c4ca34 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:41.134269 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-559845dc-cfc6-447d-8e6d-9d8c56c4ca34 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:41.134749 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-559845dc-cfc6-447d-8e6d-9d8c56c4ca34 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:41.135531 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-559845dc-cfc6-447d-8e6d-9d8c56c4ca34 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:41.135961 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-559845dc-cfc6-447d-8e6d-9d8c56c4ca34 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:41.155510 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-13963e57-4e3a-4e8a-b18c-7474bac78276 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:41.160445 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-559845dc-cfc6-447d-8e6d-9d8c56c4ca34 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lazy-loading 'flavor' on Instance uuid 31b89d15-5832-49f1-936c-f8219d65c62b {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:15:41.163202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-13963e57-4e3a-4e8a-b18c-7474bac78276 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 200 len: 1304 microversion: 2.1 time: 0.103346 Apr 05 11:15:41.163783 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 148/304] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:41 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:41.168341 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ad2d2323-9712-4d7f-a41f-93c7a859869e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:41.168944 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ad2d2323-9712-4d7f-a41f-93c7a859869e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:41.175578 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad2d2323-9712-4d7f-a41f-93c7a859869e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:41.176025 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad2d2323-9712-4d7f-a41f-93c7a859869e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:41.176801 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad2d2323-9712-4d7f-a41f-93c7a859869e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:41.177236 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad2d2323-9712-4d7f-a41f-93c7a859869e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:41.341034 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ad2d2323-9712-4d7f-a41f-93c7a859869e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:41.341034 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ad2d2323-9712-4d7f-a41f-93c7a859869e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.157996 Apr 05 11:15:41.341034 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 149/305] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:41 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:41.784946 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-559845dc-cfc6-447d-8e6d-9d8c56c4ca34 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "POST /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b/action" status: 200 len: 32 microversion: 2.1 time: 0.664542 Apr 05 11:15:41.785564 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 157/306] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:15:41 2022] POST /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b/action => generated 32 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:15:41.795274 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b0264508-6abc-470f-ad6f-582afc0bb795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:41.795886 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b0264508-6abc-470f-ad6f-582afc0bb795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:41.802036 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b0264508-6abc-470f-ad6f-582afc0bb795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:41.802233 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b0264508-6abc-470f-ad6f-582afc0bb795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:41.803054 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b0264508-6abc-470f-ad6f-582afc0bb795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:41.803485 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b0264508-6abc-470f-ad6f-582afc0bb795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:41.944569 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b0264508-6abc-470f-ad6f-582afc0bb795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:41.952474 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b0264508-6abc-470f-ad6f-582afc0bb795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.161007 Apr 05 11:15:41.953069 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 150/307] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:41 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:42.140432 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1e3e22f2-be7f-4508-9e41-da8b58b01953 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:42.141394 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1e3e22f2-be7f-4508-9e41-da8b58b01953 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:42.147673 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e3e22f2-be7f-4508-9e41-da8b58b01953 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:42.148123 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e3e22f2-be7f-4508-9e41-da8b58b01953 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:42.148892 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e3e22f2-be7f-4508-9e41-da8b58b01953 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:42.149327 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e3e22f2-be7f-4508-9e41-da8b58b01953 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:42.181716 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-25b741f2-c882-4340-871d-66b87c54ccc2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:42.182338 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-25b741f2-c882-4340-871d-66b87c54ccc2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: 37f4141f-bac2-4e5c-9171-881df70931e8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:42.188843 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-25b741f2-c882-4340-871d-66b87c54ccc2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:42.189371 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-25b741f2-c882-4340-871d-66b87c54ccc2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:42.195754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-25b741f2-c882-4340-871d-66b87c54ccc2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:42.195754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-25b741f2-c882-4340-871d-66b87c54ccc2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:42.205291 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-25b741f2-c882-4340-871d-66b87c54ccc2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] HTTP exception thrown: Instance 37f4141f-bac2-4e5c-9171-881df70931e8 could not be found. Apr 05 11:15:42.205897 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-25b741f2-c882-4340-871d-66b87c54ccc2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Returning 404 to user: Instance 37f4141f-bac2-4e5c-9171-881df70931e8 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:15:42.206765 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-25b741f2-c882-4340-871d-66b87c54ccc2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8" status: 404 len: 111 microversion: 2.1 time: 0.030653 Apr 05 11:15:42.207411 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 151/308] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:42 2022] GET /compute/v2.1/servers/37f4141f-bac2-4e5c-9171-881df70931e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:15:42.293895 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1e3e22f2-be7f-4508-9e41-da8b58b01953 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:42.301869 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1e3e22f2-be7f-4508-9e41-da8b58b01953 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.168577 Apr 05 11:15:42.302977 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 158/309] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:42 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:42.326122 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2139614145", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "networks": [{"uuid": "13b7e59c-4cc7-4c95-b837-f56effe02725"}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:42.340713 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4051da8f-5e7b-420c-a047-525faf4e3abb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:42.341692 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4051da8f-5e7b-420c-a047-525faf4e3abb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:42.349540 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4051da8f-5e7b-420c-a047-525faf4e3abb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:42.350632 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4051da8f-5e7b-420c-a047-525faf4e3abb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:42.351647 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4051da8f-5e7b-420c-a047-525faf4e3abb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:42.352169 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4051da8f-5e7b-420c-a047-525faf4e3abb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:42.381934 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] validate_networks() for [('13b7e59c-4cc7-4c95-b837-f56effe02725', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:15:42.758173 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4051da8f-5e7b-420c-a047-525faf4e3abb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:42.765596 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4051da8f-5e7b-420c-a047-525faf4e3abb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1317 microversion: 2.1 time: 0.429741 Apr 05 11:15:42.766189 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 159/310] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:42 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:42.789901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:15:42.790316 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:15:42.790906 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:15:42.791380 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:15:42.791833 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:15:42.800850 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:42.801296 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:42.802085 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:42.802511 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:42.820732 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Getting quotas for project da48f033c24346cc90296be17f7d07cc. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:15:42.824883 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Getting quotas for user bb9be3affb1042eea0f9084b632c824d and project da48f033c24346cc90296be17f7d07cc. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:15:42.836181 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:15:42.838372 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:15:42.970076 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8eac3be6-f7d4-483d-a44b-cf751a51262a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:42.970869 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8eac3be6-f7d4-483d-a44b-cf751a51262a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:42.976955 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8eac3be6-f7d4-483d-a44b-cf751a51262a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:42.977421 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8eac3be6-f7d4-483d-a44b-cf751a51262a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:42.978184 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8eac3be6-f7d4-483d-a44b-cf751a51262a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:42.978689 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8eac3be6-f7d4-483d-a44b-cf751a51262a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:43.017776 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-104a5379-7d40-491b-a09f-df6968b1b575 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695490 Apr 05 11:15:43.018958 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 152/311] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:15:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:15:43.028831 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fe1dcbcf-cb40-42e7-81d6-eac87aa2846b tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:43.029449 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fe1dcbcf-cb40-42e7-81d6-eac87aa2846b tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:43.086019 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fe1dcbcf-cb40-42e7-81d6-eac87aa2846b tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:43.093438 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fe1dcbcf-cb40-42e7-81d6-eac87aa2846b tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1214 microversion: 2.1 time: 0.068737 Apr 05 11:15:43.094893 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 153/312] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:43 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:43.133245 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8eac3be6-f7d4-483d-a44b-cf751a51262a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:43.141279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8eac3be6-f7d4-483d-a44b-cf751a51262a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.175048 Apr 05 11:15:43.142193 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 160/313] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:42 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:43.320630 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dbf2e54a-527d-4c75-97fe-02c9a3e4bf63 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:43.321270 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dbf2e54a-527d-4c75-97fe-02c9a3e4bf63 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:43.328125 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dbf2e54a-527d-4c75-97fe-02c9a3e4bf63 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:43.328574 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dbf2e54a-527d-4c75-97fe-02c9a3e4bf63 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:43.329347 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dbf2e54a-527d-4c75-97fe-02c9a3e4bf63 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:43.329785 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dbf2e54a-527d-4c75-97fe-02c9a3e4bf63 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:43.537811 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-dbf2e54a-527d-4c75-97fe-02c9a3e4bf63 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:43.545795 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dbf2e54a-527d-4c75-97fe-02c9a3e4bf63 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.229080 Apr 05 11:15:43.552871 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 154/314] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:43 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:43.789953 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-53a39638-4449-475f-a508-2cf1ddf3e013 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:43.790562 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-53a39638-4449-475f-a508-2cf1ddf3e013 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:43.796875 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53a39638-4449-475f-a508-2cf1ddf3e013 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:43.797319 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53a39638-4449-475f-a508-2cf1ddf3e013 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:43.798092 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53a39638-4449-475f-a508-2cf1ddf3e013 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:43.798521 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53a39638-4449-475f-a508-2cf1ddf3e013 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:43.941255 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-53a39638-4449-475f-a508-2cf1ddf3e013 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:43.949309 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-53a39638-4449-475f-a508-2cf1ddf3e013 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1505 microversion: 2.1 time: 0.163928 Apr 05 11:15:43.949891 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 161/315] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:43 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:44.111717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a704d005-9cd8-498e-b0f1-ab40a517c1a5 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:44.112876 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a704d005-9cd8-498e-b0f1-ab40a517c1a5 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:44.158845 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-38349676-8c07-42ac-b519-a82ea6ea5c92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:44.159623 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-38349676-8c07-42ac-b519-a82ea6ea5c92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:44.169439 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-38349676-8c07-42ac-b519-a82ea6ea5c92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:44.169897 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-38349676-8c07-42ac-b519-a82ea6ea5c92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:44.170933 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-38349676-8c07-42ac-b519-a82ea6ea5c92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:44.171437 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-38349676-8c07-42ac-b519-a82ea6ea5c92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:44.182521 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a704d005-9cd8-498e-b0f1-ab40a517c1a5 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:44.191319 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a704d005-9cd8-498e-b0f1-ab40a517c1a5 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1214 microversion: 2.1 time: 0.083264 Apr 05 11:15:44.193321 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 155/316] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:44 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:44.273921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-77496cb0-202f-4665-b66b-1fbabf27d894 req-4e6a8341-c645-4035-923b-832e2e470b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf850eb7-85c7-4f51-b38a-c369acc62596", "name": "network-vif-plugged", "status": "completed", "tag": "6b821c49-a4b3-4ed6-bcb3-9b364b775da0"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:44.297591 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-77496cb0-202f-4665-b66b-1fbabf27d894 req-4e6a8341-c645-4035-923b-832e2e470b74 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:44.298166 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-77496cb0-202f-4665-b66b-1fbabf27d894 req-4e6a8341-c645-4035-923b-832e2e470b74 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:44.310918 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-77496cb0-202f-4665-b66b-1fbabf27d894 req-4e6a8341-c645-4035-923b-832e2e470b74 service nova] Creating event network-vif-plugged:6b821c49-a4b3-4ed6-bcb3-9b364b775da0 for instance bf850eb7-85c7-4f51-b38a-c369acc62596 on hv-cinder-81899 Apr 05 11:15:44.316156 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-77496cb0-202f-4665-b66b-1fbabf27d894 req-4e6a8341-c645-4035-923b-832e2e470b74 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046680 Apr 05 11:15:44.317036 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 156/317] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:15:44.324812 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-38349676-8c07-42ac-b519-a82ea6ea5c92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:44.333526 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-38349676-8c07-42ac-b519-a82ea6ea5c92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.178705 Apr 05 11:15:44.340147 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 162/318] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:44 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:44.563594 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3bd6758e-df8b-45a5-98cf-4d015681c49c tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:44.564288 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3bd6758e-df8b-45a5-98cf-4d015681c49c tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:44.570503 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bd6758e-df8b-45a5-98cf-4d015681c49c tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:44.571005 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bd6758e-df8b-45a5-98cf-4d015681c49c tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:44.571777 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bd6758e-df8b-45a5-98cf-4d015681c49c tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:44.572212 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bd6758e-df8b-45a5-98cf-4d015681c49c tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:44.747635 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3bd6758e-df8b-45a5-98cf-4d015681c49c tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:44.755550 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3bd6758e-df8b-45a5-98cf-4d015681c49c tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.196083 Apr 05 11:15:44.756236 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 157/319] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:44 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:45.209884 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fdee5e0f-f6b0-4304-a96c-607f9952ae0b tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:45.210668 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fdee5e0f-f6b0-4304-a96c-607f9952ae0b tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:45.216763 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fdee5e0f-f6b0-4304-a96c-607f9952ae0b tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:45.217209 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fdee5e0f-f6b0-4304-a96c-607f9952ae0b tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:45.217966 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fdee5e0f-f6b0-4304-a96c-607f9952ae0b tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:45.218419 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fdee5e0f-f6b0-4304-a96c-607f9952ae0b tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:45.288604 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fdee5e0f-f6b0-4304-a96c-607f9952ae0b tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:45.295978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fdee5e0f-f6b0-4304-a96c-607f9952ae0b tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1210 microversion: 2.1 time: 0.090534 Apr 05 11:15:45.296556 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 163/320] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:45 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:45.349957 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a24ea5f9-b93d-46e9-81b1-dc2111a27fd6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:45.350563 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a24ea5f9-b93d-46e9-81b1-dc2111a27fd6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:45.356957 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a24ea5f9-b93d-46e9-81b1-dc2111a27fd6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:45.357403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a24ea5f9-b93d-46e9-81b1-dc2111a27fd6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:45.358169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a24ea5f9-b93d-46e9-81b1-dc2111a27fd6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:45.358627 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a24ea5f9-b93d-46e9-81b1-dc2111a27fd6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:45.498774 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a24ea5f9-b93d-46e9-81b1-dc2111a27fd6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:45.506868 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a24ea5f9-b93d-46e9-81b1-dc2111a27fd6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.160296 Apr 05 11:15:45.507496 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 158/321] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:45 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:45.773811 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1bcc8219-c0fe-4f60-9c24-73850e661c61 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:45.774425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1bcc8219-c0fe-4f60-9c24-73850e661c61 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:45.780455 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1bcc8219-c0fe-4f60-9c24-73850e661c61 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:45.780906 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1bcc8219-c0fe-4f60-9c24-73850e661c61 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:45.781676 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1bcc8219-c0fe-4f60-9c24-73850e661c61 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:45.782143 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1bcc8219-c0fe-4f60-9c24-73850e661c61 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:45.920006 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1bcc8219-c0fe-4f60-9c24-73850e661c61 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:45.927243 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1bcc8219-c0fe-4f60-9c24-73850e661c61 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.158889 Apr 05 11:15:45.928316 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 164/322] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:45 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:46.313031 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1118047e-3d20-490c-933c-38c3a39339db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:46.319121 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1118047e-3d20-490c-933c-38c3a39339db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:46.320960 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1118047e-3d20-490c-933c-38c3a39339db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:46.321424 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1118047e-3d20-490c-933c-38c3a39339db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:46.322203 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1118047e-3d20-490c-933c-38c3a39339db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:46.322666 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1118047e-3d20-490c-933c-38c3a39339db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:46.382803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1118047e-3d20-490c-933c-38c3a39339db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:46.390742 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1118047e-3d20-490c-933c-38c3a39339db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1266 microversion: 2.1 time: 0.081450 Apr 05 11:15:46.391335 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 159/323] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:46 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:46.526183 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-974612de-fdeb-4948-a6c8-dfc00b902f79 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:46.527126 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-974612de-fdeb-4948-a6c8-dfc00b902f79 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:46.533222 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-974612de-fdeb-4948-a6c8-dfc00b902f79 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:46.533670 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-974612de-fdeb-4948-a6c8-dfc00b902f79 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:46.534445 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-974612de-fdeb-4948-a6c8-dfc00b902f79 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:46.534918 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-974612de-fdeb-4948-a6c8-dfc00b902f79 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:46.676785 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-974612de-fdeb-4948-a6c8-dfc00b902f79 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:46.687930 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-974612de-fdeb-4948-a6c8-dfc00b902f79 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.164528 Apr 05 11:15:46.687930 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 165/324] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:46 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:46.944637 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-52acd4be-df19-47d0-8446-2abf618c14f2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:46.945258 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-52acd4be-df19-47d0-8446-2abf618c14f2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:46.951452 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52acd4be-df19-47d0-8446-2abf618c14f2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:46.951909 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52acd4be-df19-47d0-8446-2abf618c14f2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:46.952684 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52acd4be-df19-47d0-8446-2abf618c14f2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:46.953136 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52acd4be-df19-47d0-8446-2abf618c14f2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:47.095960 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-52acd4be-df19-47d0-8446-2abf618c14f2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:47.103971 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-52acd4be-df19-47d0-8446-2abf618c14f2 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1315 microversion: 2.1 time: 0.163355 Apr 05 11:15:47.104571 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 160/325] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:46 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:47.408474 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7aabbf2a-2114-406f-82ae-f219bc624779 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:47.409106 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7aabbf2a-2114-406f-82ae-f219bc624779 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:47.415696 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7aabbf2a-2114-406f-82ae-f219bc624779 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:47.416147 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7aabbf2a-2114-406f-82ae-f219bc624779 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:47.416914 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7aabbf2a-2114-406f-82ae-f219bc624779 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:47.417350 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7aabbf2a-2114-406f-82ae-f219bc624779 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:47.485766 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7aabbf2a-2114-406f-82ae-f219bc624779 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:47.493725 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7aabbf2a-2114-406f-82ae-f219bc624779 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1274 microversion: 2.1 time: 0.088996 Apr 05 11:15:47.494324 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 166/326] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:47 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:47.703568 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-82629536-978b-464d-9e25-c29ebad18a1f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:47.704230 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-82629536-978b-464d-9e25-c29ebad18a1f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:47.716234 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-82629536-978b-464d-9e25-c29ebad18a1f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:47.716690 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-82629536-978b-464d-9e25-c29ebad18a1f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:47.717473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-82629536-978b-464d-9e25-c29ebad18a1f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:47.717904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-82629536-978b-464d-9e25-c29ebad18a1f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:47.869618 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-82629536-978b-464d-9e25-c29ebad18a1f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:47.877006 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-82629536-978b-464d-9e25-c29ebad18a1f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.177323 Apr 05 11:15:47.877594 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 161/327] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:47 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:48.121636 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5acae26b-36c3-4565-9c56-c3313363e888 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:48.122341 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5acae26b-36c3-4565-9c56-c3313363e888 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:48.129209 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5acae26b-36c3-4565-9c56-c3313363e888 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:48.130267 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5acae26b-36c3-4565-9c56-c3313363e888 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:48.131403 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5acae26b-36c3-4565-9c56-c3313363e888 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:48.131987 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5acae26b-36c3-4565-9c56-c3313363e888 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:48.272209 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5acae26b-36c3-4565-9c56-c3313363e888 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:48.280003 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5acae26b-36c3-4565-9c56-c3313363e888 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1464 microversion: 2.1 time: 0.162083 Apr 05 11:15:48.280594 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 167/328] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:48 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:48.320708 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e07a29f4-803d-4467-8584-2b2d88d5f85f tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:48.321195 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e07a29f4-803d-4467-8584-2b2d88d5f85f tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:48.327552 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e07a29f4-803d-4467-8584-2b2d88d5f85f tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:48.327998 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e07a29f4-803d-4467-8584-2b2d88d5f85f tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:48.328851 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e07a29f4-803d-4467-8584-2b2d88d5f85f tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:48.329202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e07a29f4-803d-4467-8584-2b2d88d5f85f tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:48.354341 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e07a29f4-803d-4467-8584-2b2d88d5f85f tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:15:48.511415 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a6f4d8b8-3ea8-4f36-a42d-7820ad8a0392 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:48.512047 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a6f4d8b8-3ea8-4f36-a42d-7820ad8a0392 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:48.518193 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6f4d8b8-3ea8-4f36-a42d-7820ad8a0392 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:48.518713 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6f4d8b8-3ea8-4f36-a42d-7820ad8a0392 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:48.519491 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6f4d8b8-3ea8-4f36-a42d-7820ad8a0392 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:48.519954 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6f4d8b8-3ea8-4f36-a42d-7820ad8a0392 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:48.660761 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a6f4d8b8-3ea8-4f36-a42d-7820ad8a0392 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:48.668973 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a6f4d8b8-3ea8-4f36-a42d-7820ad8a0392 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1314 microversion: 2.1 time: 0.161395 Apr 05 11:15:48.669570 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 168/329] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:48 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:48.843365 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e07a29f4-803d-4467-8584-2b2d88d5f85f tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 204 len: 0 microversion: 2.1 time: 0.526184 Apr 05 11:15:48.844564 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 162/330] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:15:48 2022] DELETE /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:15:48.853416 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-314a31bc-7c6e-407a-aee3-12705ffb79cc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:48.854025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-314a31bc-7c6e-407a-aee3-12705ffb79cc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:48.860666 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-314a31bc-7c6e-407a-aee3-12705ffb79cc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:48.862586 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-314a31bc-7c6e-407a-aee3-12705ffb79cc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:48.862586 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-314a31bc-7c6e-407a-aee3-12705ffb79cc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:48.862586 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-314a31bc-7c6e-407a-aee3-12705ffb79cc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:48.895912 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-75e7dfe0-7212-4f6c-b93c-3ae54fd70452 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:48.897126 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-75e7dfe0-7212-4f6c-b93c-3ae54fd70452 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:48.904577 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-75e7dfe0-7212-4f6c-b93c-3ae54fd70452 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:48.905210 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-75e7dfe0-7212-4f6c-b93c-3ae54fd70452 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:48.906482 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-75e7dfe0-7212-4f6c-b93c-3ae54fd70452 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:48.907052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-75e7dfe0-7212-4f6c-b93c-3ae54fd70452 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:49.025698 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-314a31bc-7c6e-407a-aee3-12705ffb79cc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:49.033611 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-314a31bc-7c6e-407a-aee3-12705ffb79cc tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1470 microversion: 2.1 time: 0.184654 Apr 05 11:15:49.034187 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 169/331] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:48 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1470 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:49.225408 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-75e7dfe0-7212-4f6c-b93c-3ae54fd70452 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:49.233852 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-75e7dfe0-7212-4f6c-b93c-3ae54fd70452 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.342245 Apr 05 11:15:49.234439 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 163/332] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:48 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:49.686646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f3bc7b0f-13e8-4d54-b854-05b242708af9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:49.687253 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f3bc7b0f-13e8-4d54-b854-05b242708af9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:49.694040 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f3bc7b0f-13e8-4d54-b854-05b242708af9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:49.694494 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f3bc7b0f-13e8-4d54-b854-05b242708af9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:49.695305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f3bc7b0f-13e8-4d54-b854-05b242708af9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:49.695744 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f3bc7b0f-13e8-4d54-b854-05b242708af9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:49.747612 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-129a4b3a-757f-4d5c-a529-4b23f6a059f6 req-572573f6-c5a9-4a0d-9d3f-3046afd1c45d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf973bc2-e445-440b-943e-c2824d829b9d", "tag": "dfc4e00d-e1a4-41e7-9ecd-cec275a003b1"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:49.757914 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-129a4b3a-757f-4d5c-a529-4b23f6a059f6 req-572573f6-c5a9-4a0d-9d3f-3046afd1c45d service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:49.758502 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-129a4b3a-757f-4d5c-a529-4b23f6a059f6 req-572573f6-c5a9-4a0d-9d3f-3046afd1c45d service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:49.771247 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-129a4b3a-757f-4d5c-a529-4b23f6a059f6 req-572573f6-c5a9-4a0d-9d3f-3046afd1c45d service nova] Creating event network-changed:dfc4e00d-e1a4-41e7-9ecd-cec275a003b1 for instance cf973bc2-e445-440b-943e-c2824d829b9d on hv-cinder-81899 Apr 05 11:15:49.776305 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-129a4b3a-757f-4d5c-a529-4b23f6a059f6 req-572573f6-c5a9-4a0d-9d3f-3046afd1c45d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032405 Apr 05 11:15:49.776986 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 164/333] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:15:49.854868 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f3bc7b0f-13e8-4d54-b854-05b242708af9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:49.862138 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f3bc7b0f-13e8-4d54-b854-05b242708af9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1314 microversion: 2.1 time: 0.179360 Apr 05 11:15:49.862732 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 170/334] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:49 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:50.061231 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4eb516a7-47e8-45bb-b6dc-c24442eacf86 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:50.062010 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4eb516a7-47e8-45bb-b6dc-c24442eacf86 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:50.069052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4eb516a7-47e8-45bb-b6dc-c24442eacf86 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:50.069568 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4eb516a7-47e8-45bb-b6dc-c24442eacf86 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:50.070388 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4eb516a7-47e8-45bb-b6dc-c24442eacf86 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:50.070861 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4eb516a7-47e8-45bb-b6dc-c24442eacf86 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:50.207132 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4eb516a7-47e8-45bb-b6dc-c24442eacf86 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:50.215194 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4eb516a7-47e8-45bb-b6dc-c24442eacf86 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1470 microversion: 2.1 time: 0.158344 Apr 05 11:15:50.215768 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 165/335] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:50 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:50.250836 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-09c79040-1e42-429a-a359-6c8e1f3970a7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:50.251448 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-09c79040-1e42-429a-a359-6c8e1f3970a7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:50.257438 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09c79040-1e42-429a-a359-6c8e1f3970a7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:50.257889 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09c79040-1e42-429a-a359-6c8e1f3970a7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:50.258680 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09c79040-1e42-429a-a359-6c8e1f3970a7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:50.259112 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09c79040-1e42-429a-a359-6c8e1f3970a7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:50.392978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-09c79040-1e42-429a-a359-6c8e1f3970a7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:50.400666 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-09c79040-1e42-429a-a359-6c8e1f3970a7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.154057 Apr 05 11:15:50.401235 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 171/336] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:50 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:50.879448 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d5ebe691-5f8c-4c21-9bc8-6512f744fa99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:50.880059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d5ebe691-5f8c-4c21-9bc8-6512f744fa99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:50.886938 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d5ebe691-5f8c-4c21-9bc8-6512f744fa99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:50.887500 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d5ebe691-5f8c-4c21-9bc8-6512f744fa99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:50.888212 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d5ebe691-5f8c-4c21-9bc8-6512f744fa99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:50.888645 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d5ebe691-5f8c-4c21-9bc8-6512f744fa99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:51.056642 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d5ebe691-5f8c-4c21-9bc8-6512f744fa99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:51.064213 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d5ebe691-5f8c-4c21-9bc8-6512f744fa99 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1314 microversion: 2.1 time: 0.188609 Apr 05 11:15:51.064834 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 166/337] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:50 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:51.235347 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-97fdacfe-62fa-4195-af78-1ab57f5ceea1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:51.237031 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-97fdacfe-62fa-4195-af78-1ab57f5ceea1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:51.244458 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-97fdacfe-62fa-4195-af78-1ab57f5ceea1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:51.245378 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-97fdacfe-62fa-4195-af78-1ab57f5ceea1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:51.246373 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-97fdacfe-62fa-4195-af78-1ab57f5ceea1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:51.254394 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-97fdacfe-62fa-4195-af78-1ab57f5ceea1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:51.418321 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1673cddd-34ff-4072-aba2-00cfb7b9228b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:51.419492 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1673cddd-34ff-4072-aba2-00cfb7b9228b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:51.426824 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1673cddd-34ff-4072-aba2-00cfb7b9228b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:51.427477 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1673cddd-34ff-4072-aba2-00cfb7b9228b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:51.429000 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1673cddd-34ff-4072-aba2-00cfb7b9228b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:51.429734 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1673cddd-34ff-4072-aba2-00cfb7b9228b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:51.548216 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-97fdacfe-62fa-4195-af78-1ab57f5ceea1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:51.560383 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-97fdacfe-62fa-4195-af78-1ab57f5ceea1 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1470 microversion: 2.1 time: 0.330799 Apr 05 11:15:51.561231 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 172/338] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:51 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1470 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:51.701941 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1673cddd-34ff-4072-aba2-00cfb7b9228b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:51.710347 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1673cddd-34ff-4072-aba2-00cfb7b9228b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.296044 Apr 05 11:15:51.710949 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 167/339] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:51 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:51.966360 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-d743a125-8454-44ed-8385-e56a612bec31 req-50680f4a-e2de-4e1b-b9c4-087ad0c303e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf850eb7-85c7-4f51-b38a-c369acc62596", "name": "network-vif-deleted", "tag": "6b821c49-a4b3-4ed6-bcb3-9b364b775da0"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:15:51.975637 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-d743a125-8454-44ed-8385-e56a612bec31 req-50680f4a-e2de-4e1b-b9c4-087ad0c303e4 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:51.976187 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-d743a125-8454-44ed-8385-e56a612bec31 req-50680f4a-e2de-4e1b-b9c4-087ad0c303e4 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:51.988224 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-d743a125-8454-44ed-8385-e56a612bec31 req-50680f4a-e2de-4e1b-b9c4-087ad0c303e4 service nova] Creating event network-vif-deleted:6b821c49-a4b3-4ed6-bcb3-9b364b775da0 for instance bf850eb7-85c7-4f51-b38a-c369acc62596 on hv-cinder-81899 Apr 05 11:15:51.993741 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-d743a125-8454-44ed-8385-e56a612bec31 req-50680f4a-e2de-4e1b-b9c4-087ad0c303e4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030989 Apr 05 11:15:51.994351 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 173/340] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:15:52.083638 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bcc9005c-3ec0-42f6-a0b4-3a25ca9d8785 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:52.083638 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bcc9005c-3ec0-42f6-a0b4-3a25ca9d8785 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:52.089227 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bcc9005c-3ec0-42f6-a0b4-3a25ca9d8785 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:52.089692 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bcc9005c-3ec0-42f6-a0b4-3a25ca9d8785 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:52.090503 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bcc9005c-3ec0-42f6-a0b4-3a25ca9d8785 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:52.091026 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bcc9005c-3ec0-42f6-a0b4-3a25ca9d8785 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:52.232809 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bcc9005c-3ec0-42f6-a0b4-3a25ca9d8785 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:52.240496 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bcc9005c-3ec0-42f6-a0b4-3a25ca9d8785 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1314 microversion: 2.1 time: 0.163014 Apr 05 11:15:52.241104 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 168/341] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:52 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:52.578657 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8f8c6d33-9fda-423e-acab-952b92707aa5 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:52.579355 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8f8c6d33-9fda-423e-acab-952b92707aa5 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:52.585513 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f8c6d33-9fda-423e-acab-952b92707aa5 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:52.585960 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f8c6d33-9fda-423e-acab-952b92707aa5 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:52.586760 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f8c6d33-9fda-423e-acab-952b92707aa5 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:52.587195 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f8c6d33-9fda-423e-acab-952b92707aa5 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:52.649547 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8f8c6d33-9fda-423e-acab-952b92707aa5 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:52.657033 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8f8c6d33-9fda-423e-acab-952b92707aa5 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1428 microversion: 2.1 time: 0.082574 Apr 05 11:15:52.657602 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 174/342] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:52 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1428 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:52.727533 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-72bbeeb6-e951-43e0-9415-1df86403a1d6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:52.728135 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-72bbeeb6-e951-43e0-9415-1df86403a1d6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:52.734136 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72bbeeb6-e951-43e0-9415-1df86403a1d6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:52.734581 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72bbeeb6-e951-43e0-9415-1df86403a1d6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:52.735356 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72bbeeb6-e951-43e0-9415-1df86403a1d6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:52.735784 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72bbeeb6-e951-43e0-9415-1df86403a1d6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:52.874159 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-72bbeeb6-e951-43e0-9415-1df86403a1d6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:52.881660 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-72bbeeb6-e951-43e0-9415-1df86403a1d6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.158053 Apr 05 11:15:52.882225 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 169/343] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:52 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:53.258567 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e221f9ac-2b34-4ecc-b4e1-c63d239404e1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:53.258567 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e221f9ac-2b34-4ecc-b4e1-c63d239404e1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:53.265042 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e221f9ac-2b34-4ecc-b4e1-c63d239404e1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:53.265494 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e221f9ac-2b34-4ecc-b4e1-c63d239404e1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:53.266283 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e221f9ac-2b34-4ecc-b4e1-c63d239404e1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:53.266751 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e221f9ac-2b34-4ecc-b4e1-c63d239404e1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:53.463325 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e221f9ac-2b34-4ecc-b4e1-c63d239404e1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:53.472447 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e221f9ac-2b34-4ecc-b4e1-c63d239404e1 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1314 microversion: 2.1 time: 0.218992 Apr 05 11:15:53.473269 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 175/344] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:53 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:53.674473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2db75669-8a44-4668-ab6a-12dc9f7314b9 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:53.675126 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2db75669-8a44-4668-ab6a-12dc9f7314b9 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:53.682473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2db75669-8a44-4668-ab6a-12dc9f7314b9 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:53.682956 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2db75669-8a44-4668-ab6a-12dc9f7314b9 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:53.683702 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2db75669-8a44-4668-ab6a-12dc9f7314b9 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:53.684131 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2db75669-8a44-4668-ab6a-12dc9f7314b9 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:53.741648 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2db75669-8a44-4668-ab6a-12dc9f7314b9 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:53.749598 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2db75669-8a44-4668-ab6a-12dc9f7314b9 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1428 microversion: 2.1 time: 0.078872 Apr 05 11:15:53.750174 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 170/345] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:53 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:53.899098 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-69c33c70-775d-4700-b35c-7667878632f5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:53.899710 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-69c33c70-775d-4700-b35c-7667878632f5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:53.906194 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-69c33c70-775d-4700-b35c-7667878632f5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:53.906653 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-69c33c70-775d-4700-b35c-7667878632f5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:53.907438 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-69c33c70-775d-4700-b35c-7667878632f5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:53.907867 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-69c33c70-775d-4700-b35c-7667878632f5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:54.055513 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-69c33c70-775d-4700-b35c-7667878632f5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:54.064006 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-69c33c70-775d-4700-b35c-7667878632f5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.169249 Apr 05 11:15:54.064616 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 176/346] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:53 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:54.492449 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2419925b-72d7-4bdb-842f-fb8ef0a49edd tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:54.493086 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2419925b-72d7-4bdb-842f-fb8ef0a49edd tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:54.499902 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2419925b-72d7-4bdb-842f-fb8ef0a49edd tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:54.500346 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2419925b-72d7-4bdb-842f-fb8ef0a49edd tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:54.501121 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2419925b-72d7-4bdb-842f-fb8ef0a49edd tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:54.501554 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2419925b-72d7-4bdb-842f-fb8ef0a49edd tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:54.645581 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2419925b-72d7-4bdb-842f-fb8ef0a49edd tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:54.653774 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2419925b-72d7-4bdb-842f-fb8ef0a49edd tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1314 microversion: 2.1 time: 0.165920 Apr 05 11:15:54.654345 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 171/347] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:54 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:54.766979 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-474ab58d-2acf-4b18-9221-16584adfad38 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:54.767583 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-474ab58d-2acf-4b18-9221-16584adfad38 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:54.774390 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-474ab58d-2acf-4b18-9221-16584adfad38 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:54.774875 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-474ab58d-2acf-4b18-9221-16584adfad38 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:54.775753 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-474ab58d-2acf-4b18-9221-16584adfad38 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:54.776225 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-474ab58d-2acf-4b18-9221-16584adfad38 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:54.836962 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-474ab58d-2acf-4b18-9221-16584adfad38 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:54.844177 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-474ab58d-2acf-4b18-9221-16584adfad38 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1428 microversion: 2.1 time: 0.080993 Apr 05 11:15:54.844916 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 177/348] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:54 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:55.080993 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-781c6b70-ea3b-408c-8e15-e39798cbfdaf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:55.081595 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-781c6b70-ea3b-408c-8e15-e39798cbfdaf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:55.088639 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-781c6b70-ea3b-408c-8e15-e39798cbfdaf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:55.089053 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-781c6b70-ea3b-408c-8e15-e39798cbfdaf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:55.089784 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-781c6b70-ea3b-408c-8e15-e39798cbfdaf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:55.090219 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-781c6b70-ea3b-408c-8e15-e39798cbfdaf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:55.225202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-781c6b70-ea3b-408c-8e15-e39798cbfdaf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:55.233424 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-781c6b70-ea3b-408c-8e15-e39798cbfdaf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.156511 Apr 05 11:15:55.237803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 172/349] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:55 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:55.671479 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0ab98ae5-46b7-402a-bbed-0400a7b0830d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:55.672095 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0ab98ae5-46b7-402a-bbed-0400a7b0830d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:55.678404 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ab98ae5-46b7-402a-bbed-0400a7b0830d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:55.678891 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ab98ae5-46b7-402a-bbed-0400a7b0830d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:55.679708 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ab98ae5-46b7-402a-bbed-0400a7b0830d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:55.680149 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ab98ae5-46b7-402a-bbed-0400a7b0830d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:55.819386 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0ab98ae5-46b7-402a-bbed-0400a7b0830d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:55.826652 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0ab98ae5-46b7-402a-bbed-0400a7b0830d tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1314 microversion: 2.1 time: 0.159086 Apr 05 11:15:55.827228 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 178/350] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:55 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:55.862528 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-12e989d1-b4b9-4956-8513-b59c93713c8a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:55.863157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-12e989d1-b4b9-4956-8513-b59c93713c8a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:55.869130 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-12e989d1-b4b9-4956-8513-b59c93713c8a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:55.869579 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-12e989d1-b4b9-4956-8513-b59c93713c8a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:55.870337 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-12e989d1-b4b9-4956-8513-b59c93713c8a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:55.870806 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-12e989d1-b4b9-4956-8513-b59c93713c8a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:55.933942 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-12e989d1-b4b9-4956-8513-b59c93713c8a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:55.941337 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-12e989d1-b4b9-4956-8513-b59c93713c8a tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1428 microversion: 2.1 time: 0.082726 Apr 05 11:15:55.941905 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 173/351] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:55 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1428 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:56.251300 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-759bb8ab-07e3-43ae-b606-030f8b72492b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:56.252064 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-759bb8ab-07e3-43ae-b606-030f8b72492b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:56.258630 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-759bb8ab-07e3-43ae-b606-030f8b72492b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:56.261696 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-759bb8ab-07e3-43ae-b606-030f8b72492b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:56.261696 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-759bb8ab-07e3-43ae-b606-030f8b72492b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:56.261696 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-759bb8ab-07e3-43ae-b606-030f8b72492b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:56.402777 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-759bb8ab-07e3-43ae-b606-030f8b72492b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:56.411170 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-759bb8ab-07e3-43ae-b606-030f8b72492b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.163998 Apr 05 11:15:56.411809 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 179/352] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:56 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:56.843556 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-21e8132d-6d2a-4500-8ae2-2b7a3d48dce2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:56.844167 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-21e8132d-6d2a-4500-8ae2-2b7a3d48dce2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:56.851521 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-21e8132d-6d2a-4500-8ae2-2b7a3d48dce2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:56.851927 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-21e8132d-6d2a-4500-8ae2-2b7a3d48dce2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:56.853008 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-21e8132d-6d2a-4500-8ae2-2b7a3d48dce2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:56.853680 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-21e8132d-6d2a-4500-8ae2-2b7a3d48dce2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:56.958446 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e7c25e22-8a6e-4de7-bb47-3d10e2f2fd59 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:56.959577 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e7c25e22-8a6e-4de7-bb47-3d10e2f2fd59 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:56.965874 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7c25e22-8a6e-4de7-bb47-3d10e2f2fd59 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:56.966545 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7c25e22-8a6e-4de7-bb47-3d10e2f2fd59 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:56.967347 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7c25e22-8a6e-4de7-bb47-3d10e2f2fd59 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:56.967777 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7c25e22-8a6e-4de7-bb47-3d10e2f2fd59 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:57.000796 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-21e8132d-6d2a-4500-8ae2-2b7a3d48dce2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:57.005368 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7c25e22-8a6e-4de7-bb47-3d10e2f2fd59 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:57.005824 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7c25e22-8a6e-4de7-bb47-3d10e2f2fd59 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:57.006292 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-e7c25e22-8a6e-4de7-bb47-3d10e2f2fd59 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lazy-loading 'fault' on Instance uuid bf850eb7-85c7-4f51-b38a-c369acc62596 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:15:57.009341 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-21e8132d-6d2a-4500-8ae2-2b7a3d48dce2 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1314 microversion: 2.1 time: 0.169659 Apr 05 11:15:57.010372 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 174/353] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:56 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:57.051952 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e7c25e22-8a6e-4de7-bb47-3d10e2f2fd59 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272395388d14ee3991d3026cb9e83a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a31684ddc4f1791f1567eb691022c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:57.059862 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e7c25e22-8a6e-4de7-bb47-3d10e2f2fd59 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 200 len: 1305 microversion: 2.1 time: 0.105241 Apr 05 11:15:57.060674 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 180/354] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:56 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:15:57.433754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-77a5bfee-1302-4496-a61d-129caf42aa45 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:57.434491 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-77a5bfee-1302-4496-a61d-129caf42aa45 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:57.440690 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77a5bfee-1302-4496-a61d-129caf42aa45 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:57.441137 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77a5bfee-1302-4496-a61d-129caf42aa45 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:57.441944 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77a5bfee-1302-4496-a61d-129caf42aa45 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:57.442439 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77a5bfee-1302-4496-a61d-129caf42aa45 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:57.583214 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-77a5bfee-1302-4496-a61d-129caf42aa45 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:57.591409 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-77a5bfee-1302-4496-a61d-129caf42aa45 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.161778 Apr 05 11:15:57.591983 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 175/355] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:57 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:58.027245 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ed2d9235-f390-4d8a-a1fa-f93b261f69db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:58.027864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ed2d9235-f390-4d8a-a1fa-f93b261f69db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:58.033746 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ed2d9235-f390-4d8a-a1fa-f93b261f69db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:58.034181 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ed2d9235-f390-4d8a-a1fa-f93b261f69db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:58.035003 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ed2d9235-f390-4d8a-a1fa-f93b261f69db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:58.035441 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ed2d9235-f390-4d8a-a1fa-f93b261f69db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:58.083359 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-cd4e4641-6a89-4144-bd58-c3d5fc4b4929 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:58.084543 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-cd4e4641-6a89-4144-bd58-c3d5fc4b4929 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] [instance: bf850eb7-85c7-4f51-b38a-c369acc62596] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:58.091638 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd4e4641-6a89-4144-bd58-c3d5fc4b4929 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:58.092052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd4e4641-6a89-4144-bd58-c3d5fc4b4929 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:58.092837 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd4e4641-6a89-4144-bd58-c3d5fc4b4929 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:58.093276 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd4e4641-6a89-4144-bd58-c3d5fc4b4929 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:58.108545 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-cd4e4641-6a89-4144-bd58-c3d5fc4b4929 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] HTTP exception thrown: Instance bf850eb7-85c7-4f51-b38a-c369acc62596 could not be found. Apr 05 11:15:58.109513 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-cd4e4641-6a89-4144-bd58-c3d5fc4b4929 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] Returning 404 to user: Instance bf850eb7-85c7-4f51-b38a-c369acc62596 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:15:58.110968 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-cd4e4641-6a89-4144-bd58-c3d5fc4b4929 tempest-VolumesNegativeTest-2056358960 tempest-VolumesNegativeTest-2056358960-project] 10.222.0.39 "GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596" status: 404 len: 111 microversion: 2.1 time: 0.031628 Apr 05 11:15:58.111753 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 176/356] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:58 2022] GET /compute/v2.1/servers/bf850eb7-85c7-4f51-b38a-c369acc62596 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:15:58.184086 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ed2d9235-f390-4d8a-a1fa-f93b261f69db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:58.186506 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ed2d9235-f390-4d8a-a1fa-f93b261f69db tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1314 microversion: 2.1 time: 0.163040 Apr 05 11:15:58.187124 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 181/357] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:58 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:58.613812 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a904f6c4-24a6-4da5-bccb-03b05b33259a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:58.615928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a904f6c4-24a6-4da5-bccb-03b05b33259a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:58.626646 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a904f6c4-24a6-4da5-bccb-03b05b33259a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:58.626646 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a904f6c4-24a6-4da5-bccb-03b05b33259a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:58.626646 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a904f6c4-24a6-4da5-bccb-03b05b33259a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:58.626646 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a904f6c4-24a6-4da5-bccb-03b05b33259a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:58.773704 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a904f6c4-24a6-4da5-bccb-03b05b33259a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:58.781289 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a904f6c4-24a6-4da5-bccb-03b05b33259a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.176020 Apr 05 11:15:58.781761 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 177/358] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:58 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:59.205994 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-aa1b3672-23e1-4ad9-bf57-9e433e22794e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:59.206793 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-aa1b3672-23e1-4ad9-bf57-9e433e22794e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:59.213044 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aa1b3672-23e1-4ad9-bf57-9e433e22794e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:59.215725 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aa1b3672-23e1-4ad9-bf57-9e433e22794e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:59.215725 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aa1b3672-23e1-4ad9-bf57-9e433e22794e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:59.215725 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aa1b3672-23e1-4ad9-bf57-9e433e22794e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:59.352831 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-aa1b3672-23e1-4ad9-bf57-9e433e22794e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:59.359975 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-aa1b3672-23e1-4ad9-bf57-9e433e22794e tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1314 microversion: 2.1 time: 0.158095 Apr 05 11:15:59.360532 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 182/359] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:59 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:15:59.797945 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5ed526bb-a617-4585-a584-a65046b55915 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:15:59.798549 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5ed526bb-a617-4585-a584-a65046b55915 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:15:59.805602 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5ed526bb-a617-4585-a584-a65046b55915 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:59.806081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5ed526bb-a617-4585-a584-a65046b55915 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:59.806949 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5ed526bb-a617-4585-a584-a65046b55915 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:15:59.807409 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5ed526bb-a617-4585-a584-a65046b55915 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:15:59.947932 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5ed526bb-a617-4585-a584-a65046b55915 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:15:59.955846 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5ed526bb-a617-4585-a584-a65046b55915 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.161775 Apr 05 11:15:59.956415 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 178/360] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:15:59 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:00.378854 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c2489b23-2102-4dd5-ac99-386cfeb7f5f9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:00.379545 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c2489b23-2102-4dd5-ac99-386cfeb7f5f9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:00.385986 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c2489b23-2102-4dd5-ac99-386cfeb7f5f9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:00.386352 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c2489b23-2102-4dd5-ac99-386cfeb7f5f9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:00.387197 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c2489b23-2102-4dd5-ac99-386cfeb7f5f9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:00.387636 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c2489b23-2102-4dd5-ac99-386cfeb7f5f9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:00.528272 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c2489b23-2102-4dd5-ac99-386cfeb7f5f9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:00.535489 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c2489b23-2102-4dd5-ac99-386cfeb7f5f9 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1314 microversion: 2.1 time: 0.160728 Apr 05 11:16:00.536099 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 183/361] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:00 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:00.638035 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-4ce608f8-448f-46a1-a502-c09e2f0a0bdd req-c7ba479b-67f1-420a-b986-5bb4a5e57f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf973bc2-e445-440b-943e-c2824d829b9d", "name": "network-vif-plugged", "status": "completed", "tag": "dfc4e00d-e1a4-41e7-9ecd-cec275a003b1"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:16:00.646950 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-4ce608f8-448f-46a1-a502-c09e2f0a0bdd req-c7ba479b-67f1-420a-b986-5bb4a5e57f5e service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:00.647713 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-4ce608f8-448f-46a1-a502-c09e2f0a0bdd req-c7ba479b-67f1-420a-b986-5bb4a5e57f5e service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:00.659308 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-4ce608f8-448f-46a1-a502-c09e2f0a0bdd req-c7ba479b-67f1-420a-b986-5bb4a5e57f5e service nova] Creating event network-vif-plugged:dfc4e00d-e1a4-41e7-9ecd-cec275a003b1 for instance cf973bc2-e445-440b-943e-c2824d829b9d on hv-cinder-81899 Apr 05 11:16:00.664986 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-4ce608f8-448f-46a1-a502-c09e2f0a0bdd req-c7ba479b-67f1-420a-b986-5bb4a5e57f5e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030720 Apr 05 11:16:00.665610 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 179/362] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:16:00.973242 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f938ba44-b2cc-465f-870f-a93c4084f71e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:00.974158 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f938ba44-b2cc-465f-870f-a93c4084f71e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:00.981725 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f938ba44-b2cc-465f-870f-a93c4084f71e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:00.982177 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f938ba44-b2cc-465f-870f-a93c4084f71e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:00.982989 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f938ba44-b2cc-465f-870f-a93c4084f71e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:00.983433 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f938ba44-b2cc-465f-870f-a93c4084f71e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:01.139824 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f938ba44-b2cc-465f-870f-a93c4084f71e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:01.147969 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f938ba44-b2cc-465f-870f-a93c4084f71e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.178677 Apr 05 11:16:01.148537 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 184/363] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:00 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:01.553804 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-00938735-0d6f-4c4b-9b51-6e3d5c399da3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:01.554502 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-00938735-0d6f-4c4b-9b51-6e3d5c399da3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:01.561710 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-00938735-0d6f-4c4b-9b51-6e3d5c399da3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:01.561710 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-00938735-0d6f-4c4b-9b51-6e3d5c399da3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:01.562462 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-00938735-0d6f-4c4b-9b51-6e3d5c399da3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:01.562945 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-00938735-0d6f-4c4b-9b51-6e3d5c399da3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:01.715965 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-00938735-0d6f-4c4b-9b51-6e3d5c399da3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:01.723409 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-00938735-0d6f-4c4b-9b51-6e3d5c399da3 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1314 microversion: 2.1 time: 0.174798 Apr 05 11:16:01.723971 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 180/364] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:01 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:02.165178 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-23e6864c-8b0a-4588-980c-0e853ab5f7bc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:02.165782 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-23e6864c-8b0a-4588-980c-0e853ab5f7bc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:02.171753 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-23e6864c-8b0a-4588-980c-0e853ab5f7bc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:02.172214 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-23e6864c-8b0a-4588-980c-0e853ab5f7bc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:02.172988 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-23e6864c-8b0a-4588-980c-0e853ab5f7bc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:02.173421 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-23e6864c-8b0a-4588-980c-0e853ab5f7bc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:02.310952 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-23e6864c-8b0a-4588-980c-0e853ab5f7bc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:02.318489 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-23e6864c-8b0a-4588-980c-0e853ab5f7bc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.157678 Apr 05 11:16:02.319094 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 185/365] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:02 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:02.739579 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-173deb2f-a96c-40f3-bdfd-d1f84f690622 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:02.740185 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-173deb2f-a96c-40f3-bdfd-d1f84f690622 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:02.746573 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-173deb2f-a96c-40f3-bdfd-d1f84f690622 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:02.747052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-173deb2f-a96c-40f3-bdfd-d1f84f690622 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:02.749678 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-173deb2f-a96c-40f3-bdfd-d1f84f690622 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:02.749678 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-173deb2f-a96c-40f3-bdfd-d1f84f690622 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:02.890478 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-173deb2f-a96c-40f3-bdfd-d1f84f690622 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:02.905531 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-173deb2f-a96c-40f3-bdfd-d1f84f690622 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1314 microversion: 2.1 time: 0.168764 Apr 05 11:16:02.905531 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 181/366] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:02 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:03.348477 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cebc74d6-7688-4146-b797-e5468051f4af tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:03.349971 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cebc74d6-7688-4146-b797-e5468051f4af tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:03.357629 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cebc74d6-7688-4146-b797-e5468051f4af tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:03.358258 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cebc74d6-7688-4146-b797-e5468051f4af tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:03.359169 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cebc74d6-7688-4146-b797-e5468051f4af tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:03.360210 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cebc74d6-7688-4146-b797-e5468051f4af tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:03.509938 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cebc74d6-7688-4146-b797-e5468051f4af tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:03.518093 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cebc74d6-7688-4146-b797-e5468051f4af tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.173842 Apr 05 11:16:03.518855 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 186/367] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:03 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:03.921310 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d2b66a91-93df-4d00-8c92-2eb65c7abea4 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:03.921915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d2b66a91-93df-4d00-8c92-2eb65c7abea4 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:03.928751 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2b66a91-93df-4d00-8c92-2eb65c7abea4 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:03.929212 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2b66a91-93df-4d00-8c92-2eb65c7abea4 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:03.929999 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2b66a91-93df-4d00-8c92-2eb65c7abea4 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:03.930640 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2b66a91-93df-4d00-8c92-2eb65c7abea4 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:04.070666 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d2b66a91-93df-4d00-8c92-2eb65c7abea4 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:04.078174 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d2b66a91-93df-4d00-8c92-2eb65c7abea4 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1498 microversion: 2.1 time: 0.160719 Apr 05 11:16:04.078764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 182/368] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:03 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:04.534674 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3065fa46-6100-4d71-a4b1-03a16c4bb7a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:04.535427 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3065fa46-6100-4d71-a4b1-03a16c4bb7a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:04.541531 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3065fa46-6100-4d71-a4b1-03a16c4bb7a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:04.544513 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3065fa46-6100-4d71-a4b1-03a16c4bb7a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:04.544513 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3065fa46-6100-4d71-a4b1-03a16c4bb7a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:04.544513 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3065fa46-6100-4d71-a4b1-03a16c4bb7a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:04.690095 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3065fa46-6100-4d71-a4b1-03a16c4bb7a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:04.698205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3065fa46-6100-4d71-a4b1-03a16c4bb7a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.167439 Apr 05 11:16:04.698801 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 187/369] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:04 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:05.090062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d0674eb5-ffdf-405d-9588-b8155f71d066 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:05.090896 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d0674eb5-ffdf-405d-9588-b8155f71d066 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:05.099899 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0674eb5-ffdf-405d-9588-b8155f71d066 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:05.100542 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0674eb5-ffdf-405d-9588-b8155f71d066 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:05.101133 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0674eb5-ffdf-405d-9588-b8155f71d066 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:05.101650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0674eb5-ffdf-405d-9588-b8155f71d066 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:05.128348 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d0674eb5-ffdf-405d-9588-b8155f71d066 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:16:05.489478 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d0674eb5-ffdf-405d-9588-b8155f71d066 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 204 len: 0 microversion: 2.1 time: 0.404288 Apr 05 11:16:05.493153 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 183/370] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:16:05 2022] DELETE /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:16:05.499359 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-34086d3c-7f76-47c7-b8d5-f400d7220688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:05.500124 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-34086d3c-7f76-47c7-b8d5-f400d7220688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:05.506295 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34086d3c-7f76-47c7-b8d5-f400d7220688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:05.506954 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34086d3c-7f76-47c7-b8d5-f400d7220688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:05.507894 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34086d3c-7f76-47c7-b8d5-f400d7220688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:05.508322 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34086d3c-7f76-47c7-b8d5-f400d7220688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:05.652405 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-34086d3c-7f76-47c7-b8d5-f400d7220688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:05.659947 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-34086d3c-7f76-47c7-b8d5-f400d7220688 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1504 microversion: 2.1 time: 0.165157 Apr 05 11:16:05.660676 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 188/371] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:05 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:05.715531 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c10be492-7f7b-4be7-85f4-5544fe6b0eae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:05.716238 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c10be492-7f7b-4be7-85f4-5544fe6b0eae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:05.722943 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c10be492-7f7b-4be7-85f4-5544fe6b0eae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:05.723404 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c10be492-7f7b-4be7-85f4-5544fe6b0eae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:05.724185 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c10be492-7f7b-4be7-85f4-5544fe6b0eae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:05.724626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c10be492-7f7b-4be7-85f4-5544fe6b0eae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:05.881860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c10be492-7f7b-4be7-85f4-5544fe6b0eae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:05.889288 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c10be492-7f7b-4be7-85f4-5544fe6b0eae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.177993 Apr 05 11:16:05.889872 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 184/372] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:05 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:06.677968 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-28448669-d9e8-4d10-9ede-37c00b8fc2bc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:06.678648 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-28448669-d9e8-4d10-9ede-37c00b8fc2bc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:06.684840 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-28448669-d9e8-4d10-9ede-37c00b8fc2bc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:06.685283 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-28448669-d9e8-4d10-9ede-37c00b8fc2bc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:06.686047 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-28448669-d9e8-4d10-9ede-37c00b8fc2bc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:06.686480 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-28448669-d9e8-4d10-9ede-37c00b8fc2bc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:06.825017 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-28448669-d9e8-4d10-9ede-37c00b8fc2bc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:06.832882 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-28448669-d9e8-4d10-9ede-37c00b8fc2bc tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1504 microversion: 2.1 time: 0.159401 Apr 05 11:16:06.833524 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 189/373] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:06 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:06.906258 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9b31829a-0d23-40b8-972c-f1ad62757142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:06.906901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9b31829a-0d23-40b8-972c-f1ad62757142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:06.913394 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b31829a-0d23-40b8-972c-f1ad62757142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:06.913847 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b31829a-0d23-40b8-972c-f1ad62757142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:06.914635 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b31829a-0d23-40b8-972c-f1ad62757142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:06.915080 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b31829a-0d23-40b8-972c-f1ad62757142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:07.061572 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9b31829a-0d23-40b8-972c-f1ad62757142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:07.069430 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9b31829a-0d23-40b8-972c-f1ad62757142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.167071 Apr 05 11:16:07.070085 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 185/374] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:06 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:07.849365 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-638ad1af-fbaf-46ee-aa0f-06600a4b857f tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:07.849953 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-638ad1af-fbaf-46ee-aa0f-06600a4b857f tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:07.856229 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-638ad1af-fbaf-46ee-aa0f-06600a4b857f tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:07.856678 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-638ad1af-fbaf-46ee-aa0f-06600a4b857f tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:07.857449 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-638ad1af-fbaf-46ee-aa0f-06600a4b857f tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:07.857885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-638ad1af-fbaf-46ee-aa0f-06600a4b857f tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:07.991537 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-638ad1af-fbaf-46ee-aa0f-06600a4b857f tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:07.999198 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-638ad1af-fbaf-46ee-aa0f-06600a4b857f tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1504 microversion: 2.1 time: 0.153679 Apr 05 11:16:07.999775 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 190/375] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:07 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:08.087510 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d96de36b-1631-4050-991b-fb43014cabda tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:08.088128 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d96de36b-1631-4050-991b-fb43014cabda tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:08.094561 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d96de36b-1631-4050-991b-fb43014cabda tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:08.095046 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d96de36b-1631-4050-991b-fb43014cabda tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:08.095860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d96de36b-1631-4050-991b-fb43014cabda tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:08.096300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d96de36b-1631-4050-991b-fb43014cabda tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:08.309942 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d96de36b-1631-4050-991b-fb43014cabda tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:08.319464 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d96de36b-1631-4050-991b-fb43014cabda tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.236400 Apr 05 11:16:08.320055 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 186/376] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:08 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:08.518150 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-1b5e1c65-544c-4ad0-a727-ef6acf97a6c1 req-db8ba212-4188-4158-8662-24f90f0b91eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf973bc2-e445-440b-943e-c2824d829b9d", "name": "network-vif-deleted", "tag": "dfc4e00d-e1a4-41e7-9ecd-cec275a003b1"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:16:08.526180 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-1b5e1c65-544c-4ad0-a727-ef6acf97a6c1 req-db8ba212-4188-4158-8662-24f90f0b91eb service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:08.526634 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-1b5e1c65-544c-4ad0-a727-ef6acf97a6c1 req-db8ba212-4188-4158-8662-24f90f0b91eb service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:08.537898 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-1b5e1c65-544c-4ad0-a727-ef6acf97a6c1 req-db8ba212-4188-4158-8662-24f90f0b91eb service nova] Creating event network-vif-deleted:dfc4e00d-e1a4-41e7-9ecd-cec275a003b1 for instance cf973bc2-e445-440b-943e-c2824d829b9d on hv-cinder-81899 Apr 05 11:16:08.543231 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-1b5e1c65-544c-4ad0-a727-ef6acf97a6c1 req-db8ba212-4188-4158-8662-24f90f0b91eb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029173 Apr 05 11:16:08.543970 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 191/377] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:16:09.016770 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e8aa8728-e53e-4951-a56a-4ded03cce55c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:09.017403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e8aa8728-e53e-4951-a56a-4ded03cce55c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:09.023820 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e8aa8728-e53e-4951-a56a-4ded03cce55c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:09.026971 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e8aa8728-e53e-4951-a56a-4ded03cce55c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:09.026971 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e8aa8728-e53e-4951-a56a-4ded03cce55c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:09.026971 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e8aa8728-e53e-4951-a56a-4ded03cce55c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:09.055977 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e8aa8728-e53e-4951-a56a-4ded03cce55c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:09.056426 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e8aa8728-e53e-4951-a56a-4ded03cce55c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:09.056961 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-e8aa8728-e53e-4951-a56a-4ded03cce55c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lazy-loading 'fault' on Instance uuid cf973bc2-e445-440b-943e-c2824d829b9d {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:16:09.096404 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e8aa8728-e53e-4951-a56a-4ded03cce55c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9be3affb1042eea0f9084b632c824d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da48f033c24346cc90296be17f7d07cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:09.104706 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e8aa8728-e53e-4951-a56a-4ded03cce55c tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 200 len: 1304 microversion: 2.1 time: 0.091825 Apr 05 11:16:09.105304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 187/378] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:09 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:09.337654 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-10aa3e87-3bf6-4255-a9ed-bb6350942198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:09.338544 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-10aa3e87-3bf6-4255-a9ed-bb6350942198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:09.344674 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10aa3e87-3bf6-4255-a9ed-bb6350942198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:09.345070 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10aa3e87-3bf6-4255-a9ed-bb6350942198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:09.345943 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10aa3e87-3bf6-4255-a9ed-bb6350942198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:09.346273 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10aa3e87-3bf6-4255-a9ed-bb6350942198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:09.485420 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-10aa3e87-3bf6-4255-a9ed-bb6350942198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:09.494661 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-10aa3e87-3bf6-4255-a9ed-bb6350942198 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.161769 Apr 05 11:16:09.495267 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 192/379] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:09 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:10.121707 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8f81009b-bc03-41b5-9352-7634a1725d24 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:10.122304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8f81009b-bc03-41b5-9352-7634a1725d24 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] [instance: cf973bc2-e445-440b-943e-c2824d829b9d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:10.128871 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f81009b-bc03-41b5-9352-7634a1725d24 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:10.129313 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f81009b-bc03-41b5-9352-7634a1725d24 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:10.130101 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f81009b-bc03-41b5-9352-7634a1725d24 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:10.130526 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f81009b-bc03-41b5-9352-7634a1725d24 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:10.143489 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-8f81009b-bc03-41b5-9352-7634a1725d24 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] HTTP exception thrown: Instance cf973bc2-e445-440b-943e-c2824d829b9d could not be found. Apr 05 11:16:10.144119 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8f81009b-bc03-41b5-9352-7634a1725d24 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] Returning 404 to user: Instance cf973bc2-e445-440b-943e-c2824d829b9d could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:16:10.144923 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8f81009b-bc03-41b5-9352-7634a1725d24 tempest-VolumesActionsTest-269684169 tempest-VolumesActionsTest-269684169-project] 10.222.0.39 "GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d" status: 404 len: 111 microversion: 2.1 time: 0.027175 Apr 05 11:16:10.145489 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 188/380] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:10 2022] GET /compute/v2.1/servers/cf973bc2-e445-440b-943e-c2824d829b9d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:16:10.512325 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-13f37901-20f4-4f5d-a466-ada4023f61ae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:10.513051 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-13f37901-20f4-4f5d-a466-ada4023f61ae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:10.521097 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-13f37901-20f4-4f5d-a466-ada4023f61ae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:10.521645 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-13f37901-20f4-4f5d-a466-ada4023f61ae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:10.522441 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-13f37901-20f4-4f5d-a466-ada4023f61ae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:10.522902 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-13f37901-20f4-4f5d-a466-ada4023f61ae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:10.677685 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-13f37901-20f4-4f5d-a466-ada4023f61ae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:10.684037 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-13f37901-20f4-4f5d-a466-ada4023f61ae tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.175665 Apr 05 11:16:10.684647 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 193/381] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:10 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:11.700757 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-57a16cf1-c0e8-4472-be9b-0a691925f73b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:11.701368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-57a16cf1-c0e8-4472-be9b-0a691925f73b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:11.707613 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57a16cf1-c0e8-4472-be9b-0a691925f73b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:11.708052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57a16cf1-c0e8-4472-be9b-0a691925f73b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:11.708805 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57a16cf1-c0e8-4472-be9b-0a691925f73b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:11.709303 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57a16cf1-c0e8-4472-be9b-0a691925f73b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:11.846760 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-57a16cf1-c0e8-4472-be9b-0a691925f73b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:11.854486 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-57a16cf1-c0e8-4472-be9b-0a691925f73b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.157905 Apr 05 11:16:11.855071 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 189/382] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:11 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:12.870644 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6dd898e5-4929-4a29-b88b-185679f68585 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:12.871190 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6dd898e5-4929-4a29-b88b-185679f68585 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:12.877223 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6dd898e5-4929-4a29-b88b-185679f68585 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:12.877818 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6dd898e5-4929-4a29-b88b-185679f68585 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:12.878576 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6dd898e5-4929-4a29-b88b-185679f68585 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:12.879029 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6dd898e5-4929-4a29-b88b-185679f68585 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:13.011297 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6dd898e5-4929-4a29-b88b-185679f68585 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:13.017699 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6dd898e5-4929-4a29-b88b-185679f68585 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.150964 Apr 05 11:16:13.018271 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 194/383] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:12 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:14.034323 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-33efca76-9404-48fc-906b-0b0d78059c23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:14.034952 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-33efca76-9404-48fc-906b-0b0d78059c23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:14.041706 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33efca76-9404-48fc-906b-0b0d78059c23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:14.042147 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33efca76-9404-48fc-906b-0b0d78059c23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:14.042928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33efca76-9404-48fc-906b-0b0d78059c23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:14.043356 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33efca76-9404-48fc-906b-0b0d78059c23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:14.171533 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-33efca76-9404-48fc-906b-0b0d78059c23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:14.178748 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-33efca76-9404-48fc-906b-0b0d78059c23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.148282 Apr 05 11:16:14.179310 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 190/384] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:14 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:15.194932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-50732570-21f6-4e02-94aa-c017abbf0d14 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:15.196039 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-50732570-21f6-4e02-94aa-c017abbf0d14 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:15.202046 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50732570-21f6-4e02-94aa-c017abbf0d14 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:15.202494 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50732570-21f6-4e02-94aa-c017abbf0d14 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:15.203344 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50732570-21f6-4e02-94aa-c017abbf0d14 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:15.203780 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50732570-21f6-4e02-94aa-c017abbf0d14 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:15.337535 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-50732570-21f6-4e02-94aa-c017abbf0d14 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:15.344807 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-50732570-21f6-4e02-94aa-c017abbf0d14 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.153854 Apr 05 11:16:15.345376 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 195/385] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:15 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:16.343191 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f0f89ae9-814d-4194-bb89-7ae93b0fc356 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:16.343686 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f0f89ae9-814d-4194-bb89-7ae93b0fc356 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:16.349940 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0f89ae9-814d-4194-bb89-7ae93b0fc356 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:16.350381 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0f89ae9-814d-4194-bb89-7ae93b0fc356 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:16.351173 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0f89ae9-814d-4194-bb89-7ae93b0fc356 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:16.351605 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0f89ae9-814d-4194-bb89-7ae93b0fc356 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:16.369123 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-538c6296-f671-4ad9-b197-1efd757bbff4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:16.369764 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-538c6296-f671-4ad9-b197-1efd757bbff4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:16.374440 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f0f89ae9-814d-4194-bb89-7ae93b0fc356 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/ips" status: 200 len: 153 microversion: 2.20 time: 0.035126 Apr 05 11:16:16.375043 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 191/386] 10.222.0.39 () {60 vars in 1288 bytes} [Tue Apr 5 11:16:16 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/ips => generated 153 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:16:16.375969 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-538c6296-f671-4ad9-b197-1efd757bbff4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:16.376457 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-538c6296-f671-4ad9-b197-1efd757bbff4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:16.377231 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-538c6296-f671-4ad9-b197-1efd757bbff4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:16.377667 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-538c6296-f671-4ad9-b197-1efd757bbff4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:16.668170 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-538c6296-f671-4ad9-b197-1efd757bbff4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:16.675567 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-538c6296-f671-4ad9-b197-1efd757bbff4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.310255 Apr 05 11:16:16.676180 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 196/387] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:16 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:16:17.692578 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-eb1a94bb-6e21-4147-8ff9-1c7215c8ffbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:17.693177 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-eb1a94bb-6e21-4147-8ff9-1c7215c8ffbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:17.699104 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eb1a94bb-6e21-4147-8ff9-1c7215c8ffbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:17.699547 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eb1a94bb-6e21-4147-8ff9-1c7215c8ffbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:17.700296 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eb1a94bb-6e21-4147-8ff9-1c7215c8ffbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:17.700725 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eb1a94bb-6e21-4147-8ff9-1c7215c8ffbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:17.833747 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-eb1a94bb-6e21-4147-8ff9-1c7215c8ffbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:17.841644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-eb1a94bb-6e21-4147-8ff9-1c7215c8ffbf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.152894 Apr 05 11:16:17.842202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 192/388] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:17 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:18.858135 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b0ecf964-82cf-49f2-87f0-3e462ef86de0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:18.858767 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b0ecf964-82cf-49f2-87f0-3e462ef86de0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:18.864582 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b0ecf964-82cf-49f2-87f0-3e462ef86de0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:18.865025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b0ecf964-82cf-49f2-87f0-3e462ef86de0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:18.865774 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b0ecf964-82cf-49f2-87f0-3e462ef86de0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:18.866205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b0ecf964-82cf-49f2-87f0-3e462ef86de0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:18.995810 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b0ecf964-82cf-49f2-87f0-3e462ef86de0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:19.003485 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b0ecf964-82cf-49f2-87f0-3e462ef86de0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.149807 Apr 05 11:16:19.004060 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 197/389] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:18 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:19.144191 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d9032aad-d403-4b6c-a414-e56abb8b82d5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:19.144737 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d9032aad-d403-4b6c-a414-e56abb8b82d5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:19.151040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d9032aad-d403-4b6c-a414-e56abb8b82d5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:19.151488 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d9032aad-d403-4b6c-a414-e56abb8b82d5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:19.152966 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d9032aad-d403-4b6c-a414-e56abb8b82d5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:19.153396 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d9032aad-d403-4b6c-a414-e56abb8b82d5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:19.177421 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d9032aad-d403-4b6c-a414-e56abb8b82d5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/ips" status: 200 len: 145 microversion: 2.1 time: 0.037126 Apr 05 11:16:19.178143 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 193/390] 10.222.0.39 () {58 vars in 1247 bytes} [Tue Apr 5 11:16:19 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:16:20.021061 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0a7e04e7-f49b-4eca-8f03-6e753901a251 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:20.021664 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0a7e04e7-f49b-4eca-8f03-6e753901a251 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:20.027434 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a7e04e7-f49b-4eca-8f03-6e753901a251 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:20.027878 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a7e04e7-f49b-4eca-8f03-6e753901a251 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:20.029139 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a7e04e7-f49b-4eca-8f03-6e753901a251 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:20.029573 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a7e04e7-f49b-4eca-8f03-6e753901a251 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:20.164645 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0a7e04e7-f49b-4eca-8f03-6e753901a251 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:20.173018 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0a7e04e7-f49b-4eca-8f03-6e753901a251 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.155702 Apr 05 11:16:20.177309 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 198/391] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:20 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:21.190649 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c1af8b71-0b1b-450f-8967-0c2704ff357a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:21.191293 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c1af8b71-0b1b-450f-8967-0c2704ff357a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:21.197799 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c1af8b71-0b1b-450f-8967-0c2704ff357a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:21.198249 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c1af8b71-0b1b-450f-8967-0c2704ff357a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:21.199042 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c1af8b71-0b1b-450f-8967-0c2704ff357a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:21.199479 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c1af8b71-0b1b-450f-8967-0c2704ff357a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:21.357445 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c1af8b71-0b1b-450f-8967-0c2704ff357a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:21.364644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c1af8b71-0b1b-450f-8967-0c2704ff357a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.178107 Apr 05 11:16:21.365203 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 194/392] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:21 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:22.380944 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a77c7aab-9311-47e4-97ee-4ceebf2c896f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:22.381543 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a77c7aab-9311-47e4-97ee-4ceebf2c896f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:22.387375 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a77c7aab-9311-47e4-97ee-4ceebf2c896f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:22.387819 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a77c7aab-9311-47e4-97ee-4ceebf2c896f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:22.388572 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a77c7aab-9311-47e4-97ee-4ceebf2c896f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:22.389001 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a77c7aab-9311-47e4-97ee-4ceebf2c896f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:22.519821 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a77c7aab-9311-47e4-97ee-4ceebf2c896f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:22.529725 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a77c7aab-9311-47e4-97ee-4ceebf2c896f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.152276 Apr 05 11:16:22.541993 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 199/393] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:22 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:23.549915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-819f8ae7-8ae2-40a3-97cc-5b5808c80a58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:23.550510 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-819f8ae7-8ae2-40a3-97cc-5b5808c80a58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:23.557014 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-819f8ae7-8ae2-40a3-97cc-5b5808c80a58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:23.557461 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-819f8ae7-8ae2-40a3-97cc-5b5808c80a58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:23.558240 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-819f8ae7-8ae2-40a3-97cc-5b5808c80a58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:23.558705 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-819f8ae7-8ae2-40a3-97cc-5b5808c80a58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:23.722114 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8794de8d-0914-4480-9338-b6616c8c661b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3362e5d3-aae5-4a64-bbb5-7cae2eee7c31"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:16:23.724214 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8794de8d-0914-4480-9338-b6616c8c661b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:23.732469 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8794de8d-0914-4480-9338-b6616c8c661b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:23.732761 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-819f8ae7-8ae2-40a3-97cc-5b5808c80a58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:23.733170 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8794de8d-0914-4480-9338-b6616c8c661b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:23.734021 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8794de8d-0914-4480-9338-b6616c8c661b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:23.734468 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8794de8d-0914-4480-9338-b6616c8c661b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:23.743786 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-819f8ae7-8ae2-40a3-97cc-5b5808c80a58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.197020 Apr 05 11:16:23.745132 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 195/394] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:23 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:23.971498 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d3200488-1603-4c2c-8340-9359b47db821 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad07ec48-73c5-45fa-8f31-c5a49a98305d", "device": "/dev/sdb"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:16:23.973140 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d3200488-1603-4c2c-8340-9359b47db821 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:23.981598 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3200488-1603-4c2c-8340-9359b47db821 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:23.982074 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3200488-1603-4c2c-8340-9359b47db821 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:23.982904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3200488-1603-4c2c-8340-9359b47db821 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:23.983376 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3200488-1603-4c2c-8340-9359b47db821 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:26.674780 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8794de8d-0914-4480-9338-b6616c8c661b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "POST /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.957536 Apr 05 11:16:26.676116 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 200/395] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:16:23 2022] POST /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/os-volume_attachments => generated 194 bytes in 2960 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:16:26.683122 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b7688d37-bea2-4290-bdbf-0ec6e0155630 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:16:26.683916 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b7688d37-bea2-4290-bdbf-0ec6e0155630 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:26.693257 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b7688d37-bea2-4290-bdbf-0ec6e0155630 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:26.694319 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b7688d37-bea2-4290-bdbf-0ec6e0155630 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:26.695424 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b7688d37-bea2-4290-bdbf-0ec6e0155630 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:26.696060 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b7688d37-bea2-4290-bdbf-0ec6e0155630 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:26.722772 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-b7688d37-bea2-4290-bdbf-0ec6e0155630 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lazy-loading 'flavor' on Instance uuid c900362d-904b-4d64-a9a3-ab381ca756e3 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:16:26.791757 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d3200488-1603-4c2c-8340-9359b47db821 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "POST /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.819212 Apr 05 11:16:26.791757 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 196/396] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:16:23 2022] POST /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d/os-volume_attachments => generated 194 bytes in 2822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:16:26.805258 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3c66f5bd-1826-4198-847c-12b14f4ab3ab tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:26.806299 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3c66f5bd-1826-4198-847c-12b14f4ab3ab tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:26.814534 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3c66f5bd-1826-4198-847c-12b14f4ab3ab tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:26.815325 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3c66f5bd-1826-4198-847c-12b14f4ab3ab tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:26.816384 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3c66f5bd-1826-4198-847c-12b14f4ab3ab tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:26.816975 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3c66f5bd-1826-4198-847c-12b14f4ab3ab tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:27.019020 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3c66f5bd-1826-4198-847c-12b14f4ab3ab tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:27.026595 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3c66f5bd-1826-4198-847c-12b14f4ab3ab tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1520 microversion: 2.1 time: 0.238051 Apr 05 11:16:27.027203 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 197/397] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:26 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:27.535303 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b7688d37-bea2-4290-bdbf-0ec6e0155630 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "POST /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/action" status: 202 len: 0 microversion: 2.20 time: 0.856916 Apr 05 11:16:27.536947 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 201/398] 10.222.0.39 () {62 vars in 1318 bytes} [Tue Apr 5 11:16:26 2022] POST /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/action => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:16:27.546700 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e1f6168f-f5f7-467c-83ee-ed8dc6b9f763 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:27.547816 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e1f6168f-f5f7-467c-83ee-ed8dc6b9f763 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:27.556755 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1f6168f-f5f7-467c-83ee-ed8dc6b9f763 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:27.557408 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1f6168f-f5f7-467c-83ee-ed8dc6b9f763 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:27.558365 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1f6168f-f5f7-467c-83ee-ed8dc6b9f763 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:27.558820 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1f6168f-f5f7-467c-83ee-ed8dc6b9f763 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:28.045546 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-15fdc083-29cb-4054-bd88-2bdb7a9ba1a9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:28.064370 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-15fdc083-29cb-4054-bd88-2bdb7a9ba1a9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:28.083468 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-15fdc083-29cb-4054-bd88-2bdb7a9ba1a9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:28.087348 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-15fdc083-29cb-4054-bd88-2bdb7a9ba1a9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:28.090167 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-15fdc083-29cb-4054-bd88-2bdb7a9ba1a9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:28.090732 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-15fdc083-29cb-4054-bd88-2bdb7a9ba1a9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:28.213794 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e1f6168f-f5f7-467c-83ee-ed8dc6b9f763 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:28.213794 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e1f6168f-f5f7-467c-83ee-ed8dc6b9f763 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:28.214494 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e1f6168f-f5f7-467c-83ee-ed8dc6b9f763 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:28.214494 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e1f6168f-f5f7-467c-83ee-ed8dc6b9f763 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.660585 Apr 05 11:16:28.218283 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 198/399] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:27 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:16:28.362998 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-15fdc083-29cb-4054-bd88-2bdb7a9ba1a9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:28.362998 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-15fdc083-29cb-4054-bd88-2bdb7a9ba1a9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1500 microversion: 2.1 time: 0.315527 Apr 05 11:16:28.362998 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 202/400] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:28 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1500 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:16:28.378261 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef1e64d7-a6d3-4ec9-8306-242cc5fba76d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:28.378901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ef1e64d7-a6d3-4ec9-8306-242cc5fba76d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:28.385640 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef1e64d7-a6d3-4ec9-8306-242cc5fba76d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:28.386057 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef1e64d7-a6d3-4ec9-8306-242cc5fba76d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:28.387057 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef1e64d7-a6d3-4ec9-8306-242cc5fba76d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:28.387720 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef1e64d7-a6d3-4ec9-8306-242cc5fba76d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:28.542072 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef1e64d7-a6d3-4ec9-8306-242cc5fba76d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:28.556282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ef1e64d7-a6d3-4ec9-8306-242cc5fba76d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1514 microversion: 2.1 time: 0.177124 Apr 05 11:16:28.557884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 199/401] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:28 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:29.220531 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-94e6d686-1144-4a33-a586-76883938dbc5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:29.221472 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-94e6d686-1144-4a33-a586-76883938dbc5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:29.232932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94e6d686-1144-4a33-a586-76883938dbc5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:29.242850 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94e6d686-1144-4a33-a586-76883938dbc5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:29.242850 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94e6d686-1144-4a33-a586-76883938dbc5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:29.242850 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94e6d686-1144-4a33-a586-76883938dbc5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:29.440682 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-94e6d686-1144-4a33-a586-76883938dbc5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:29.450084 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-94e6d686-1144-4a33-a586-76883938dbc5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:29.452225 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-94e6d686-1144-4a33-a586-76883938dbc5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:29.453748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-94e6d686-1144-4a33-a586-76883938dbc5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.237314 Apr 05 11:16:29.455190 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 203/402] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:29 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:30.474716 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-46acce4b-44f9-49ca-8e2d-7e61c37e9c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:30.476447 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-46acce4b-44f9-49ca-8e2d-7e61c37e9c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:30.486706 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-46acce4b-44f9-49ca-8e2d-7e61c37e9c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:30.487585 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-46acce4b-44f9-49ca-8e2d-7e61c37e9c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:30.488904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-46acce4b-44f9-49ca-8e2d-7e61c37e9c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:30.489484 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-46acce4b-44f9-49ca-8e2d-7e61c37e9c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:30.749549 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-46acce4b-44f9-49ca-8e2d-7e61c37e9c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:30.766472 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-46acce4b-44f9-49ca-8e2d-7e61c37e9c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:30.774370 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-46acce4b-44f9-49ca-8e2d-7e61c37e9c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:30.777264 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-46acce4b-44f9-49ca-8e2d-7e61c37e9c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.306926 Apr 05 11:16:30.779978 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 200/403] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:30 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:31.680356 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8dfeb730-954e-4509-82df-4b276d3175a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:16:31.688881 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8dfeb730-954e-4509-82df-4b276d3175a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:31.692174 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8dfeb730-954e-4509-82df-4b276d3175a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:31.692622 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8dfeb730-954e-4509-82df-4b276d3175a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:31.705467 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8dfeb730-954e-4509-82df-4b276d3175a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:31.705940 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8dfeb730-954e-4509-82df-4b276d3175a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:31.741459 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-8dfeb730-954e-4509-82df-4b276d3175a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lazy-loading 'flavor' on Instance uuid e8f4506a-1e74-4699-938c-1fe000c3d0e7 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:16:31.800341 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b68031f5-2f0f-4e68-b1e5-bf7d6497b4c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:31.800882 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b68031f5-2f0f-4e68-b1e5-bf7d6497b4c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:31.813360 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b68031f5-2f0f-4e68-b1e5-bf7d6497b4c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:31.814491 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b68031f5-2f0f-4e68-b1e5-bf7d6497b4c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:31.815815 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b68031f5-2f0f-4e68-b1e5-bf7d6497b4c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:31.816639 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b68031f5-2f0f-4e68-b1e5-bf7d6497b4c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:32.140119 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8dfeb730-954e-4509-82df-4b276d3175a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "POST /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7/action" status: 200 len: 32 microversion: 2.1 time: 0.465105 Apr 05 11:16:32.145095 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 204/404] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:16:31 2022] POST /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7/action => generated 32 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:16:32.173059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b68031f5-2f0f-4e68-b1e5-bf7d6497b4c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:32.183768 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-75d4c0f3-232b-46e2-a460-dcba4ec3a243 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:32.187856 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b68031f5-2f0f-4e68-b1e5-bf7d6497b4c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:32.190650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b68031f5-2f0f-4e68-b1e5-bf7d6497b4c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:32.192589 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-75d4c0f3-232b-46e2-a460-dcba4ec3a243 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:32.192807 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b68031f5-2f0f-4e68-b1e5-bf7d6497b4c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.396745 Apr 05 11:16:32.193889 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 201/405] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:31 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:16:32.219814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75d4c0f3-232b-46e2-a460-dcba4ec3a243 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:32.219814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75d4c0f3-232b-46e2-a460-dcba4ec3a243 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:32.220869 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75d4c0f3-232b-46e2-a460-dcba4ec3a243 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:32.221367 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75d4c0f3-232b-46e2-a460-dcba4ec3a243 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:32.461437 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-75d4c0f3-232b-46e2-a460-dcba4ec3a243 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:32.470476 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-75d4c0f3-232b-46e2-a460-dcba4ec3a243 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.305297 Apr 05 11:16:32.481017 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 205/406] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:32 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:33.221110 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-89b55ed1-63b4-474a-85cf-bc1a58accb7f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:33.224091 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-89b55ed1-63b4-474a-85cf-bc1a58accb7f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:33.252292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-89b55ed1-63b4-474a-85cf-bc1a58accb7f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:33.252292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-89b55ed1-63b4-474a-85cf-bc1a58accb7f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:33.252292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-89b55ed1-63b4-474a-85cf-bc1a58accb7f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:33.252292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-89b55ed1-63b4-474a-85cf-bc1a58accb7f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:33.488462 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3e9924d6-aa34-4f35-9cce-ba0ebb6db706 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:33.489061 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3e9924d6-aa34-4f35-9cce-ba0ebb6db706 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:33.496011 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3e9924d6-aa34-4f35-9cce-ba0ebb6db706 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:33.496465 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3e9924d6-aa34-4f35-9cce-ba0ebb6db706 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:33.497690 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3e9924d6-aa34-4f35-9cce-ba0ebb6db706 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:33.498126 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3e9924d6-aa34-4f35-9cce-ba0ebb6db706 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:33.673688 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3e9924d6-aa34-4f35-9cce-ba0ebb6db706 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:33.684722 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3e9924d6-aa34-4f35-9cce-ba0ebb6db706 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.200195 Apr 05 11:16:33.694748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 206/407] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:33 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:33.742649 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-89b55ed1-63b4-474a-85cf-bc1a58accb7f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:33.754061 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-89b55ed1-63b4-474a-85cf-bc1a58accb7f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:33.756011 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-89b55ed1-63b4-474a-85cf-bc1a58accb7f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:33.758231 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-89b55ed1-63b4-474a-85cf-bc1a58accb7f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.549644 Apr 05 11:16:33.760217 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 202/408] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:33 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:34.703330 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-86e4b238-b7f7-42ce-bfe5-7e31ce56a210 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:34.704006 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-86e4b238-b7f7-42ce-bfe5-7e31ce56a210 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:34.712197 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86e4b238-b7f7-42ce-bfe5-7e31ce56a210 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:34.712197 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86e4b238-b7f7-42ce-bfe5-7e31ce56a210 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:34.712676 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86e4b238-b7f7-42ce-bfe5-7e31ce56a210 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:34.713427 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86e4b238-b7f7-42ce-bfe5-7e31ce56a210 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:34.779544 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1cedbfbe-bb08-4691-af5e-e6bb7efd8c21 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:34.781773 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1cedbfbe-bb08-4691-af5e-e6bb7efd8c21 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:34.794766 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1cedbfbe-bb08-4691-af5e-e6bb7efd8c21 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:34.795319 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1cedbfbe-bb08-4691-af5e-e6bb7efd8c21 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:34.796078 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1cedbfbe-bb08-4691-af5e-e6bb7efd8c21 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:34.796526 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1cedbfbe-bb08-4691-af5e-e6bb7efd8c21 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:34.974944 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-86e4b238-b7f7-42ce-bfe5-7e31ce56a210 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:34.990069 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-86e4b238-b7f7-42ce-bfe5-7e31ce56a210 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.292335 Apr 05 11:16:34.991240 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 207/409] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:34 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:35.101817 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1cedbfbe-bb08-4691-af5e-e6bb7efd8c21 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:35.116480 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1cedbfbe-bb08-4691-af5e-e6bb7efd8c21 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:35.119138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1cedbfbe-bb08-4691-af5e-e6bb7efd8c21 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:35.119832 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1cedbfbe-bb08-4691-af5e-e6bb7efd8c21 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.346403 Apr 05 11:16:35.120574 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 203/410] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:34 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:16:36.007633 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-63c53691-f78a-4432-8aa6-237dfdbbde50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:36.008818 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-63c53691-f78a-4432-8aa6-237dfdbbde50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:36.016248 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-63c53691-f78a-4432-8aa6-237dfdbbde50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:36.017094 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-63c53691-f78a-4432-8aa6-237dfdbbde50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:36.018158 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-63c53691-f78a-4432-8aa6-237dfdbbde50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:36.018804 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-63c53691-f78a-4432-8aa6-237dfdbbde50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:36.139388 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-04fde444-1c90-4416-a54e-4fa18f4da976 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:36.140672 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-04fde444-1c90-4416-a54e-4fa18f4da976 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:36.150202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-04fde444-1c90-4416-a54e-4fa18f4da976 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:36.151146 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-04fde444-1c90-4416-a54e-4fa18f4da976 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:36.152345 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-04fde444-1c90-4416-a54e-4fa18f4da976 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:36.153025 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-04fde444-1c90-4416-a54e-4fa18f4da976 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:36.191930 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-63c53691-f78a-4432-8aa6-237dfdbbde50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:36.226204 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-63c53691-f78a-4432-8aa6-237dfdbbde50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.222314 Apr 05 11:16:36.226811 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 208/411] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:36 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:36.407939 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-04fde444-1c90-4416-a54e-4fa18f4da976 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:36.432710 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-04fde444-1c90-4416-a54e-4fa18f4da976 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:36.434242 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-04fde444-1c90-4416-a54e-4fa18f4da976 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:36.435705 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-04fde444-1c90-4416-a54e-4fa18f4da976 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.300198 Apr 05 11:16:36.438561 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 204/412] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:36 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:36.569696 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d0da14db-924a-4b8f-a77f-9ee912b4efe7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:16:36.580256 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d0da14db-924a-4b8f-a77f-9ee912b4efe7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:36.581075 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d0da14db-924a-4b8f-a77f-9ee912b4efe7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:36.676759 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d0da14db-924a-4b8f-a77f-9ee912b4efe7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Going to try to stop instance {{(pid=117594) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 05 11:16:36.887118 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d0da14db-924a-4b8f-a77f-9ee912b4efe7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "POST /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/action" status: 202 len: 0 microversion: 2.1 time: 0.322459 Apr 05 11:16:36.888376 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 209/413] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:16:36 2022] POST /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:16:36.902351 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fdaa4d12-9ef1-481f-9bb9-c8b47b510785 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:36.903132 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fdaa4d12-9ef1-481f-9bb9-c8b47b510785 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:36.917226 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fdaa4d12-9ef1-481f-9bb9-c8b47b510785 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:36.917677 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fdaa4d12-9ef1-481f-9bb9-c8b47b510785 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:36.920436 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fdaa4d12-9ef1-481f-9bb9-c8b47b510785 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:36.920962 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fdaa4d12-9ef1-481f-9bb9-c8b47b510785 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:37.127613 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fdaa4d12-9ef1-481f-9bb9-c8b47b510785 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:37.146916 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fdaa4d12-9ef1-481f-9bb9-c8b47b510785 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.250433 Apr 05 11:16:37.148487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 205/414] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:36 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:37.255971 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-403a0d31-c239-4763-8d7c-46b51a0edc23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:37.258210 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-403a0d31-c239-4763-8d7c-46b51a0edc23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:37.266729 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-403a0d31-c239-4763-8d7c-46b51a0edc23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:37.267811 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-403a0d31-c239-4763-8d7c-46b51a0edc23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:37.268862 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-403a0d31-c239-4763-8d7c-46b51a0edc23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:37.269505 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-403a0d31-c239-4763-8d7c-46b51a0edc23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:37.456822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-58e5698e-bf15-44b7-8e9a-f9de4a87315c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:37.458165 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-58e5698e-bf15-44b7-8e9a-f9de4a87315c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:37.466478 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-403a0d31-c239-4763-8d7c-46b51a0edc23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:37.469232 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58e5698e-bf15-44b7-8e9a-f9de4a87315c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:37.469819 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58e5698e-bf15-44b7-8e9a-f9de4a87315c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:37.471408 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58e5698e-bf15-44b7-8e9a-f9de4a87315c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:37.473088 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58e5698e-bf15-44b7-8e9a-f9de4a87315c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:37.515248 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-403a0d31-c239-4763-8d7c-46b51a0edc23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.258912 Apr 05 11:16:37.515248 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 210/415] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:37 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:37.706981 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-58e5698e-bf15-44b7-8e9a-f9de4a87315c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:37.715059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-58e5698e-bf15-44b7-8e9a-f9de4a87315c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:37.716586 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-58e5698e-bf15-44b7-8e9a-f9de4a87315c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:37.718255 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-58e5698e-bf15-44b7-8e9a-f9de4a87315c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.265863 Apr 05 11:16:37.718849 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 206/416] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:37 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:38.167534 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7dd9c4a5-8107-4268-a35c-8da1ff8daa47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:38.168159 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7dd9c4a5-8107-4268-a35c-8da1ff8daa47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:38.178079 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7dd9c4a5-8107-4268-a35c-8da1ff8daa47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:38.178079 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7dd9c4a5-8107-4268-a35c-8da1ff8daa47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:38.178079 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7dd9c4a5-8107-4268-a35c-8da1ff8daa47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:38.182088 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7dd9c4a5-8107-4268-a35c-8da1ff8daa47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:38.411183 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7dd9c4a5-8107-4268-a35c-8da1ff8daa47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:38.424157 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7dd9c4a5-8107-4268-a35c-8da1ff8daa47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.262620 Apr 05 11:16:38.435969 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 211/417] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:38 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:38.525753 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fbb91d9b-1b75-4b85-8e4d-3bf1a65c9e0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:38.528295 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fbb91d9b-1b75-4b85-8e4d-3bf1a65c9e0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:38.536427 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fbb91d9b-1b75-4b85-8e4d-3bf1a65c9e0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:38.537280 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fbb91d9b-1b75-4b85-8e4d-3bf1a65c9e0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:38.538912 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fbb91d9b-1b75-4b85-8e4d-3bf1a65c9e0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:38.539562 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fbb91d9b-1b75-4b85-8e4d-3bf1a65c9e0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:38.721783 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fbb91d9b-1b75-4b85-8e4d-3bf1a65c9e0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:38.735814 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fbb91d9b-1b75-4b85-8e4d-3bf1a65c9e0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.215635 Apr 05 11:16:38.738435 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 207/418] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:38 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:38.751308 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-058dfb9b-6a6c-408b-be71-efff63b85048 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:38.751308 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-058dfb9b-6a6c-408b-be71-efff63b85048 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:38.752013 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-058dfb9b-6a6c-408b-be71-efff63b85048 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:38.752684 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-058dfb9b-6a6c-408b-be71-efff63b85048 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:38.753677 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-058dfb9b-6a6c-408b-be71-efff63b85048 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:38.754960 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-058dfb9b-6a6c-408b-be71-efff63b85048 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:38.977890 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-058dfb9b-6a6c-408b-be71-efff63b85048 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:38.989154 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-058dfb9b-6a6c-408b-be71-efff63b85048 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:38.991191 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-058dfb9b-6a6c-408b-be71-efff63b85048 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:38.992370 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-058dfb9b-6a6c-408b-be71-efff63b85048 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.258004 Apr 05 11:16:39.004044 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 212/419] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:38 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:39.448990 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-508dc311-00fa-4d31-a2a9-6852ab392479 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:39.455070 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-508dc311-00fa-4d31-a2a9-6852ab392479 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:39.477414 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-508dc311-00fa-4d31-a2a9-6852ab392479 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:39.482876 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-508dc311-00fa-4d31-a2a9-6852ab392479 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:39.482876 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-508dc311-00fa-4d31-a2a9-6852ab392479 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:39.482876 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-508dc311-00fa-4d31-a2a9-6852ab392479 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:39.766421 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8192ef9f-4050-482e-bc64-c5401a93e80e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:39.767670 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8192ef9f-4050-482e-bc64-c5401a93e80e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:39.774954 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8192ef9f-4050-482e-bc64-c5401a93e80e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:39.775671 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8192ef9f-4050-482e-bc64-c5401a93e80e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:39.776624 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8192ef9f-4050-482e-bc64-c5401a93e80e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:39.777308 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8192ef9f-4050-482e-bc64-c5401a93e80e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:39.785728 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-508dc311-00fa-4d31-a2a9-6852ab392479 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:39.805333 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-508dc311-00fa-4d31-a2a9-6852ab392479 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.358674 Apr 05 11:16:39.806886 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 208/420] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:39 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:40.012674 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a5fd23be-cabd-4171-9f31-00051c3f3f7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:40.013283 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a5fd23be-cabd-4171-9f31-00051c3f3f7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:40.028988 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5fd23be-cabd-4171-9f31-00051c3f3f7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:40.031107 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5fd23be-cabd-4171-9f31-00051c3f3f7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:40.034216 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5fd23be-cabd-4171-9f31-00051c3f3f7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:40.035380 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5fd23be-cabd-4171-9f31-00051c3f3f7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:40.076248 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8192ef9f-4050-482e-bc64-c5401a93e80e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:40.086289 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8192ef9f-4050-482e-bc64-c5401a93e80e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.324190 Apr 05 11:16:40.090565 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 213/421] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:39 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:40.310390 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a5fd23be-cabd-4171-9f31-00051c3f3f7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:40.328784 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a5fd23be-cabd-4171-9f31-00051c3f3f7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:40.331536 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a5fd23be-cabd-4171-9f31-00051c3f3f7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:40.333238 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a5fd23be-cabd-4171-9f31-00051c3f3f7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.324777 Apr 05 11:16:40.348567 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 209/422] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:40 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:40.823684 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bd0194bd-beae-4485-a9d1-621b612c0a53 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:40.824352 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bd0194bd-beae-4485-a9d1-621b612c0a53 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:40.832980 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bd0194bd-beae-4485-a9d1-621b612c0a53 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:40.836932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bd0194bd-beae-4485-a9d1-621b612c0a53 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:40.838054 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bd0194bd-beae-4485-a9d1-621b612c0a53 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:40.843766 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bd0194bd-beae-4485-a9d1-621b612c0a53 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:41.046796 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bd0194bd-beae-4485-a9d1-621b612c0a53 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:41.055965 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bd0194bd-beae-4485-a9d1-621b612c0a53 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.235935 Apr 05 11:16:41.057088 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 214/423] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:40 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:41.104650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4fe18bc6-6b82-4043-b683-0a8dc4b55607 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:41.105850 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4fe18bc6-6b82-4043-b683-0a8dc4b55607 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:41.119350 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4fe18bc6-6b82-4043-b683-0a8dc4b55607 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:41.119825 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4fe18bc6-6b82-4043-b683-0a8dc4b55607 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:41.120603 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4fe18bc6-6b82-4043-b683-0a8dc4b55607 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:41.121040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4fe18bc6-6b82-4043-b683-0a8dc4b55607 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:41.357454 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b319a2d0-a03e-44c5-9846-30269b8234e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:41.358354 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b319a2d0-a03e-44c5-9846-30269b8234e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:41.373507 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b319a2d0-a03e-44c5-9846-30269b8234e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:41.374884 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b319a2d0-a03e-44c5-9846-30269b8234e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:41.376013 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b319a2d0-a03e-44c5-9846-30269b8234e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:41.376646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b319a2d0-a03e-44c5-9846-30269b8234e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:41.626841 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b319a2d0-a03e-44c5-9846-30269b8234e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:41.637611 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b319a2d0-a03e-44c5-9846-30269b8234e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:41.640426 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b319a2d0-a03e-44c5-9846-30269b8234e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:41.641979 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b319a2d0-a03e-44c5-9846-30269b8234e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.288913 Apr 05 11:16:41.642743 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 215/424] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:41 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:16:41.774427 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4fe18bc6-6b82-4043-b683-0a8dc4b55607 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:41.782467 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4fe18bc6-6b82-4043-b683-0a8dc4b55607 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.681965 Apr 05 11:16:41.787568 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 210/425] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:41 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:42.074012 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9aa348d3-6fa5-4931-b436-bda5e3a309ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:42.074782 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9aa348d3-6fa5-4931-b436-bda5e3a309ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:42.090320 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9aa348d3-6fa5-4931-b436-bda5e3a309ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:42.090894 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9aa348d3-6fa5-4931-b436-bda5e3a309ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:42.091783 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9aa348d3-6fa5-4931-b436-bda5e3a309ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:42.092319 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9aa348d3-6fa5-4931-b436-bda5e3a309ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:42.308122 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9aa348d3-6fa5-4931-b436-bda5e3a309ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:42.316774 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9aa348d3-6fa5-4931-b436-bda5e3a309ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.247281 Apr 05 11:16:42.317713 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 216/426] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:42 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:42.478487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0a925876-7f39-4e19-9be5-c2f6d8cfd013 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:42.479053 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0a925876-7f39-4e19-9be5-c2f6d8cfd013 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:42.487539 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a925876-7f39-4e19-9be5-c2f6d8cfd013 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:42.488280 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a925876-7f39-4e19-9be5-c2f6d8cfd013 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:42.489331 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a925876-7f39-4e19-9be5-c2f6d8cfd013 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:42.489923 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a925876-7f39-4e19-9be5-c2f6d8cfd013 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:42.519736 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0a925876-7f39-4e19-9be5-c2f6d8cfd013 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/ips" status: 200 len: 150 microversion: 2.1 time: 0.045317 Apr 05 11:16:42.520546 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 211/427] 10.222.0.39 () {58 vars in 1247 bytes} [Tue Apr 5 11:16:42 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:16:42.663370 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8a455010-ae3e-4e0b-bc3f-52eb8c89d4b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:42.663988 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8a455010-ae3e-4e0b-bc3f-52eb8c89d4b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:42.671331 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8a455010-ae3e-4e0b-bc3f-52eb8c89d4b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:42.679590 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8a455010-ae3e-4e0b-bc3f-52eb8c89d4b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:42.681688 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8a455010-ae3e-4e0b-bc3f-52eb8c89d4b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:42.685878 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8a455010-ae3e-4e0b-bc3f-52eb8c89d4b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:42.805195 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a83dc985-e72e-4394-b0f4-91d868b9344c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:42.808529 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a83dc985-e72e-4394-b0f4-91d868b9344c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:42.821112 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a83dc985-e72e-4394-b0f4-91d868b9344c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:42.822910 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a83dc985-e72e-4394-b0f4-91d868b9344c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:42.825178 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a83dc985-e72e-4394-b0f4-91d868b9344c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:42.830913 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a83dc985-e72e-4394-b0f4-91d868b9344c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:43.104684 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a83dc985-e72e-4394-b0f4-91d868b9344c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:43.115534 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a83dc985-e72e-4394-b0f4-91d868b9344c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.316815 Apr 05 11:16:43.116505 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 212/428] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:42 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:43.169580 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8a455010-ae3e-4e0b-bc3f-52eb8c89d4b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:43.187125 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8a455010-ae3e-4e0b-bc3f-52eb8c89d4b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:43.190053 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8a455010-ae3e-4e0b-bc3f-52eb8c89d4b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:43.191349 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8a455010-ae3e-4e0b-bc3f-52eb8c89d4b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.534403 Apr 05 11:16:43.203613 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 217/429] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:42 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:43.335251 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6a6de627-3e5a-4041-bd66-065e5742984a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:43.336864 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6a6de627-3e5a-4041-bd66-065e5742984a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:43.346510 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6a6de627-3e5a-4041-bd66-065e5742984a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:43.347999 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6a6de627-3e5a-4041-bd66-065e5742984a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:43.349511 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6a6de627-3e5a-4041-bd66-065e5742984a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:43.350122 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6a6de627-3e5a-4041-bd66-065e5742984a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:43.627814 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6a6de627-3e5a-4041-bd66-065e5742984a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:43.638678 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6a6de627-3e5a-4041-bd66-065e5742984a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.308152 Apr 05 11:16:43.640412 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 213/430] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:43 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:44.133437 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-64450d34-13f5-4e84-b9a1-63b91bce7ed5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:44.133923 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-64450d34-13f5-4e84-b9a1-63b91bce7ed5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:44.145261 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-64450d34-13f5-4e84-b9a1-63b91bce7ed5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:44.147404 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-64450d34-13f5-4e84-b9a1-63b91bce7ed5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:44.148342 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-64450d34-13f5-4e84-b9a1-63b91bce7ed5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:44.148897 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-64450d34-13f5-4e84-b9a1-63b91bce7ed5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:44.211131 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-39313d6f-d857-4885-aa81-499b02712ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:44.211868 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-39313d6f-d857-4885-aa81-499b02712ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:44.223304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-39313d6f-d857-4885-aa81-499b02712ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:44.223761 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-39313d6f-d857-4885-aa81-499b02712ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:44.233810 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-39313d6f-d857-4885-aa81-499b02712ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:44.234276 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-39313d6f-d857-4885-aa81-499b02712ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:44.415412 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-64450d34-13f5-4e84-b9a1-63b91bce7ed5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:44.432465 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-64450d34-13f5-4e84-b9a1-63b91bce7ed5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.300793 Apr 05 11:16:44.433076 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 218/431] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:44 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:44.503611 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-39313d6f-d857-4885-aa81-499b02712ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:44.521436 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-39313d6f-d857-4885-aa81-499b02712ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:44.527526 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-39313d6f-d857-4885-aa81-499b02712ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:44.529079 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-39313d6f-d857-4885-aa81-499b02712ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.321966 Apr 05 11:16:44.529992 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 214/432] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:44 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:16:44.655795 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bb166523-bf9f-4531-8ad2-68ecb0a8100e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:44.656716 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bb166523-bf9f-4531-8ad2-68ecb0a8100e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:44.663373 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bb166523-bf9f-4531-8ad2-68ecb0a8100e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:44.664086 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bb166523-bf9f-4531-8ad2-68ecb0a8100e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:44.665196 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bb166523-bf9f-4531-8ad2-68ecb0a8100e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:44.665860 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bb166523-bf9f-4531-8ad2-68ecb0a8100e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:44.835135 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bb166523-bf9f-4531-8ad2-68ecb0a8100e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:44.845193 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bb166523-bf9f-4531-8ad2-68ecb0a8100e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.192741 Apr 05 11:16:44.845789 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 219/433] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:44 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:45.449346 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-81152ecc-4efc-4938-bde6-941378350224 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:45.449950 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-81152ecc-4efc-4938-bde6-941378350224 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:45.457344 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81152ecc-4efc-4938-bde6-941378350224 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:45.457826 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81152ecc-4efc-4938-bde6-941378350224 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:45.458743 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81152ecc-4efc-4938-bde6-941378350224 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:45.459213 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81152ecc-4efc-4938-bde6-941378350224 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:45.552942 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7fd5907a-7ab7-4c7b-8a0a-e43328513d61 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:45.553605 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7fd5907a-7ab7-4c7b-8a0a-e43328513d61 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:45.562055 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7fd5907a-7ab7-4c7b-8a0a-e43328513d61 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:45.562443 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7fd5907a-7ab7-4c7b-8a0a-e43328513d61 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:45.563246 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7fd5907a-7ab7-4c7b-8a0a-e43328513d61 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:45.563729 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7fd5907a-7ab7-4c7b-8a0a-e43328513d61 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:45.642499 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-81152ecc-4efc-4938-bde6-941378350224 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:45.650169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-81152ecc-4efc-4938-bde6-941378350224 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.204001 Apr 05 11:16:45.651762 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 215/434] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:45 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:45.754489 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7fd5907a-7ab7-4c7b-8a0a-e43328513d61 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:45.764777 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7fd5907a-7ab7-4c7b-8a0a-e43328513d61 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:45.766452 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7fd5907a-7ab7-4c7b-8a0a-e43328513d61 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:45.767891 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7fd5907a-7ab7-4c7b-8a0a-e43328513d61 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.219106 Apr 05 11:16:45.768841 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 220/435] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:45 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:45.774950 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fe460b34-e4fb-4215-a5e3-0ae3907b3e87 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51d932f8-9b6b-4cbf-b1b1-a61564bf2591"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:16:45.776459 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fe460b34-e4fb-4215-a5e3-0ae3907b3e87 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:45.784737 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fe460b34-e4fb-4215-a5e3-0ae3907b3e87 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:45.785436 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fe460b34-e4fb-4215-a5e3-0ae3907b3e87 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:45.786255 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fe460b34-e4fb-4215-a5e3-0ae3907b3e87 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:45.786719 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fe460b34-e4fb-4215-a5e3-0ae3907b3e87 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:45.926169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2102e861-b1bd-4e91-a88a-df94c589a4c7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Action: 'create', calling method: .version_select at 0x7fec0c2af040>, body: {"keypair": {"name": "tempest-TestShelveInstance-2074523442"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:16:45.944777 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-2102e861-b1bd-4e91-a88a-df94c589a4c7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Getting quotas for project b3e907fc457e4c4396437b93bfa31859. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:16:45.948824 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-2102e861-b1bd-4e91-a88a-df94c589a4c7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Getting quotas for user a33726523008433e826ed90d0ae5e81d and project b3e907fc457e4c4396437b93bfa31859. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:16:46.441081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-2102e861-b1bd-4e91-a88a-df94c589a4c7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Getting quotas for project b3e907fc457e4c4396437b93bfa31859. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:16:46.445611 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-2102e861-b1bd-4e91-a88a-df94c589a4c7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Getting quotas for user a33726523008433e826ed90d0ae5e81d and project b3e907fc457e4c4396437b93bfa31859. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:16:46.459729 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2102e861-b1bd-4e91-a88a-df94c589a4c7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.748157 Apr 05 11:16:46.460348 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 216/436] 10.222.0.39 () {60 vars in 1157 bytes} [Tue Apr 5 11:16:45 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:16:46.465078 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-40cb02d0-a992-49aa-a4db-396107223b37 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:46.466182 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-40cb02d0-a992-49aa-a4db-396107223b37 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:46.472947 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-40cb02d0-a992-49aa-a4db-396107223b37 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:46.473501 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-40cb02d0-a992-49aa-a4db-396107223b37 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:46.474148 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-40cb02d0-a992-49aa-a4db-396107223b37 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:46.474679 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-40cb02d0-a992-49aa-a4db-396107223b37 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:46.637850 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-40cb02d0-a992-49aa-a4db-396107223b37 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:46.647159 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-40cb02d0-a992-49aa-a4db-396107223b37 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.185712 Apr 05 11:16:46.648405 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 217/437] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:46 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:46.667192 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0a23f826-e774-461e-a17a-52b2c0234760 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:46.667709 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0a23f826-e774-461e-a17a-52b2c0234760 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:46.674419 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a23f826-e774-461e-a17a-52b2c0234760 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:46.674990 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a23f826-e774-461e-a17a-52b2c0234760 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:46.675895 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a23f826-e774-461e-a17a-52b2c0234760 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:46.676399 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a23f826-e774-461e-a17a-52b2c0234760 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:46.835570 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0a23f826-e774-461e-a17a-52b2c0234760 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:46.843598 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0a23f826-e774-461e-a17a-52b2c0234760 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.180599 Apr 05 11:16:46.850989 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 218/438] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:46 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:16:46.856005 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-16e29e9e-e58c-4821-a7e0-4882829bb346 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:46.856645 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-16e29e9e-e58c-4821-a7e0-4882829bb346 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:46.863058 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-16e29e9e-e58c-4821-a7e0-4882829bb346 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:46.863510 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-16e29e9e-e58c-4821-a7e0-4882829bb346 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:46.864329 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-16e29e9e-e58c-4821-a7e0-4882829bb346 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:46.864715 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-16e29e9e-e58c-4821-a7e0-4882829bb346 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:47.008362 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-16e29e9e-e58c-4821-a7e0-4882829bb346 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:47.022770 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-16e29e9e-e58c-4821-a7e0-4882829bb346 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:47.024321 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-16e29e9e-e58c-4821-a7e0-4882829bb346 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:47.025490 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-16e29e9e-e58c-4821-a7e0-4882829bb346 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.173331 Apr 05 11:16:47.026816 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 219/439] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:46 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:47.663771 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5ff6bf46-5871-4aba-ad38-3f7ea5cdb67c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:47.664502 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5ff6bf46-5871-4aba-ad38-3f7ea5cdb67c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:47.671263 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5ff6bf46-5871-4aba-ad38-3f7ea5cdb67c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:47.671715 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5ff6bf46-5871-4aba-ad38-3f7ea5cdb67c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:47.672485 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5ff6bf46-5871-4aba-ad38-3f7ea5cdb67c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:47.672919 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5ff6bf46-5871-4aba-ad38-3f7ea5cdb67c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:47.839716 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5ff6bf46-5871-4aba-ad38-3f7ea5cdb67c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:47.848060 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5ff6bf46-5871-4aba-ad38-3f7ea5cdb67c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.188045 Apr 05 11:16:47.849601 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 220/440] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:47 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:16:47.862248 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8e34c11c-c51d-448f-b526-5058afbd6539 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:47.862892 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8e34c11c-c51d-448f-b526-5058afbd6539 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:47.870290 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8e34c11c-c51d-448f-b526-5058afbd6539 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:47.870913 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8e34c11c-c51d-448f-b526-5058afbd6539 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:47.872045 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8e34c11c-c51d-448f-b526-5058afbd6539 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:47.873259 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8e34c11c-c51d-448f-b526-5058afbd6539 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:48.031982 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8e34c11c-c51d-448f-b526-5058afbd6539 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:48.039719 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8e34c11c-c51d-448f-b526-5058afbd6539 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.183328 Apr 05 11:16:48.040310 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 221/441] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:47 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:16:48.044957 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-44e7f6c9-a52a-43ef-a10b-c8521e1dfc5f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:48.046094 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-44e7f6c9-a52a-43ef-a10b-c8521e1dfc5f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:48.052011 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-44e7f6c9-a52a-43ef-a10b-c8521e1dfc5f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:48.052464 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-44e7f6c9-a52a-43ef-a10b-c8521e1dfc5f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:48.053240 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-44e7f6c9-a52a-43ef-a10b-c8521e1dfc5f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:48.053674 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-44e7f6c9-a52a-43ef-a10b-c8521e1dfc5f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:48.208294 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-44e7f6c9-a52a-43ef-a10b-c8521e1dfc5f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:48.228107 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-44e7f6c9-a52a-43ef-a10b-c8521e1dfc5f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:48.233461 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-44e7f6c9-a52a-43ef-a10b-c8521e1dfc5f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:48.237534 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-44e7f6c9-a52a-43ef-a10b-c8521e1dfc5f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.196187 Apr 05 11:16:48.238503 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 222/442] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:48 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:48.868040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c71e809d-c253-417d-87f2-aeba5079aee5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:48.869371 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c71e809d-c253-417d-87f2-aeba5079aee5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:48.876267 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c71e809d-c253-417d-87f2-aeba5079aee5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:48.876717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c71e809d-c253-417d-87f2-aeba5079aee5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:48.877529 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c71e809d-c253-417d-87f2-aeba5079aee5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:48.877969 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c71e809d-c253-417d-87f2-aeba5079aee5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:49.080833 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c71e809d-c253-417d-87f2-aeba5079aee5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:49.089141 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c71e809d-c253-417d-87f2-aeba5079aee5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.224878 Apr 05 11:16:49.089723 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 223/443] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:48 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:49.102291 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1d0aa891-7409-495e-a022-99e1418cb1b5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:49.102291 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1d0aa891-7409-495e-a022-99e1418cb1b5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:49.102291 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d0aa891-7409-495e-a022-99e1418cb1b5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:49.102291 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d0aa891-7409-495e-a022-99e1418cb1b5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:49.103447 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d0aa891-7409-495e-a022-99e1418cb1b5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:49.103906 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d0aa891-7409-495e-a022-99e1418cb1b5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:49.269655 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1d0aa891-7409-495e-a022-99e1418cb1b5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:49.278033 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1d0aa891-7409-495e-a022-99e1418cb1b5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.187141 Apr 05 11:16:49.278748 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 224/444] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:49 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:49.288292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-271a661f-572b-4212-9e1a-db3e26a6ccba tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:49.288292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-271a661f-572b-4212-9e1a-db3e26a6ccba tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:49.291580 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-271a661f-572b-4212-9e1a-db3e26a6ccba tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:49.292161 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-271a661f-572b-4212-9e1a-db3e26a6ccba tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:49.293029 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-271a661f-572b-4212-9e1a-db3e26a6ccba tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:49.293537 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-271a661f-572b-4212-9e1a-db3e26a6ccba tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:49.434953 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-271a661f-572b-4212-9e1a-db3e26a6ccba tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:49.443111 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-271a661f-572b-4212-9e1a-db3e26a6ccba tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:49.444636 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-271a661f-572b-4212-9e1a-db3e26a6ccba tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:49.445811 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-271a661f-572b-4212-9e1a-db3e26a6ccba tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.166069 Apr 05 11:16:49.446372 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 225/445] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:49 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:50.106799 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-895d7cad-779d-41f2-8c69-c2f25cfe95ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:50.107491 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-895d7cad-779d-41f2-8c69-c2f25cfe95ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:50.114556 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-895d7cad-779d-41f2-8c69-c2f25cfe95ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:50.115055 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-895d7cad-779d-41f2-8c69-c2f25cfe95ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:50.115848 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-895d7cad-779d-41f2-8c69-c2f25cfe95ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:50.116303 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-895d7cad-779d-41f2-8c69-c2f25cfe95ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:50.292038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-895d7cad-779d-41f2-8c69-c2f25cfe95ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:50.302710 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-895d7cad-779d-41f2-8c69-c2f25cfe95ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.199616 Apr 05 11:16:50.303339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 226/446] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:50 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:16:50.309431 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bedfbfbc-226f-4f57-a463-3932ee06d92a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:50.309915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bedfbfbc-226f-4f57-a463-3932ee06d92a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:50.316897 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bedfbfbc-226f-4f57-a463-3932ee06d92a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:50.317353 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bedfbfbc-226f-4f57-a463-3932ee06d92a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:50.318138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bedfbfbc-226f-4f57-a463-3932ee06d92a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:50.318579 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bedfbfbc-226f-4f57-a463-3932ee06d92a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:50.455982 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bedfbfbc-226f-4f57-a463-3932ee06d92a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:50.463879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bedfbfbc-226f-4f57-a463-3932ee06d92a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.158547 Apr 05 11:16:50.464528 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 227/447] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:50 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:50.469822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fddcd230-35a2-4fd1-a584-e80ff1120468 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:50.477612 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fddcd230-35a2-4fd1-a584-e80ff1120468 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:50.477612 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fddcd230-35a2-4fd1-a584-e80ff1120468 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:50.477612 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fddcd230-35a2-4fd1-a584-e80ff1120468 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:50.477612 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fddcd230-35a2-4fd1-a584-e80ff1120468 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:50.477964 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fddcd230-35a2-4fd1-a584-e80ff1120468 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:50.616010 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fddcd230-35a2-4fd1-a584-e80ff1120468 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:50.624084 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fddcd230-35a2-4fd1-a584-e80ff1120468 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:50.625682 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fddcd230-35a2-4fd1-a584-e80ff1120468 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:50.626867 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fddcd230-35a2-4fd1-a584-e80ff1120468 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.161328 Apr 05 11:16:50.627430 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 228/448] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:50 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:51.320787 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a559a65e-3091-47e7-996b-5d3f79f6c7c2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:51.322367 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a559a65e-3091-47e7-996b-5d3f79f6c7c2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:51.335752 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a559a65e-3091-47e7-996b-5d3f79f6c7c2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:51.336457 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a559a65e-3091-47e7-996b-5d3f79f6c7c2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:51.337619 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a559a65e-3091-47e7-996b-5d3f79f6c7c2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:51.338288 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a559a65e-3091-47e7-996b-5d3f79f6c7c2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:51.544724 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a559a65e-3091-47e7-996b-5d3f79f6c7c2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:51.553465 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a559a65e-3091-47e7-996b-5d3f79f6c7c2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.236600 Apr 05 11:16:51.554983 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 229/449] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:51 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:16:51.560246 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-883f5d1a-357e-43e9-b3f9-d1b7e242c499 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:51.562330 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-883f5d1a-357e-43e9-b3f9-d1b7e242c499 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:51.569892 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-883f5d1a-357e-43e9-b3f9-d1b7e242c499 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:51.570550 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-883f5d1a-357e-43e9-b3f9-d1b7e242c499 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:51.573492 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-883f5d1a-357e-43e9-b3f9-d1b7e242c499 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:51.573492 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-883f5d1a-357e-43e9-b3f9-d1b7e242c499 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:51.714477 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-883f5d1a-357e-43e9-b3f9-d1b7e242c499 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:51.723730 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-883f5d1a-357e-43e9-b3f9-d1b7e242c499 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.167403 Apr 05 11:16:51.724346 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 230/450] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:51 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:51.729061 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e4b3379e-b864-40a1-9793-2c5cde258c9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:51.729693 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e4b3379e-b864-40a1-9793-2c5cde258c9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:51.736415 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e4b3379e-b864-40a1-9793-2c5cde258c9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:51.736894 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e4b3379e-b864-40a1-9793-2c5cde258c9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:51.737684 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e4b3379e-b864-40a1-9793-2c5cde258c9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:51.738173 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e4b3379e-b864-40a1-9793-2c5cde258c9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:51.892156 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e4b3379e-b864-40a1-9793-2c5cde258c9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:51.900104 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e4b3379e-b864-40a1-9793-2c5cde258c9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:51.901612 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e4b3379e-b864-40a1-9793-2c5cde258c9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:51.902835 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e4b3379e-b864-40a1-9793-2c5cde258c9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1747 microversion: 2.20 time: 0.177507 Apr 05 11:16:51.903507 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 231/451] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:51 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1747 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:52.185389 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-8993c8ec-7c32-4b49-9528-372e6ab03fdc req-36efc5f7-72c6-4e92-aac9-164c66cce0cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c900362d-904b-4d64-a9a3-ab381ca756e3", "name": "network-vif-plugged", "status": "completed", "tag": "be14224c-0258-4dc2-9ce4-f41347c20fc0"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:16:52.194093 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-8993c8ec-7c32-4b49-9528-372e6ab03fdc req-36efc5f7-72c6-4e92-aac9-164c66cce0cc service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:52.194532 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-8993c8ec-7c32-4b49-9528-372e6ab03fdc req-36efc5f7-72c6-4e92-aac9-164c66cce0cc service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:52.206515 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-8993c8ec-7c32-4b49-9528-372e6ab03fdc req-36efc5f7-72c6-4e92-aac9-164c66cce0cc service nova] Creating event network-vif-plugged:be14224c-0258-4dc2-9ce4-f41347c20fc0 for instance c900362d-904b-4d64-a9a3-ab381ca756e3 on hv-cinder-81899 Apr 05 11:16:52.211842 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-8993c8ec-7c32-4b49-9528-372e6ab03fdc req-36efc5f7-72c6-4e92-aac9-164c66cce0cc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030104 Apr 05 11:16:52.212464 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 232/452] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:16:52.307928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fe460b34-e4fb-4215-a5e3-0ae3907b3e87 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "POST /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.537302 Apr 05 11:16:52.308709 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 221/453] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:16:45 2022] POST /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-volume_attachments => generated 194 bytes in 6539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:16:52.573441 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-26daa207-d8ea-4f30-9cf9-52687f96832f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:52.574061 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-26daa207-d8ea-4f30-9cf9-52687f96832f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:52.580578 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-26daa207-d8ea-4f30-9cf9-52687f96832f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:52.581043 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-26daa207-d8ea-4f30-9cf9-52687f96832f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:52.581791 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-26daa207-d8ea-4f30-9cf9-52687f96832f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:52.582227 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-26daa207-d8ea-4f30-9cf9-52687f96832f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:52.719155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-26daa207-d8ea-4f30-9cf9-52687f96832f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:52.726952 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-26daa207-d8ea-4f30-9cf9-52687f96832f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.158377 Apr 05 11:16:52.727508 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 233/454] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:52 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:52.741808 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f71eb73f-cdf6-4155-841e-ca5220b0af63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:52.742481 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f71eb73f-cdf6-4155-841e-ca5220b0af63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:52.749279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f71eb73f-cdf6-4155-841e-ca5220b0af63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:52.749725 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f71eb73f-cdf6-4155-841e-ca5220b0af63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:52.750567 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f71eb73f-cdf6-4155-841e-ca5220b0af63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:52.751033 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f71eb73f-cdf6-4155-841e-ca5220b0af63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:52.897562 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f71eb73f-cdf6-4155-841e-ca5220b0af63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:52.905975 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f71eb73f-cdf6-4155-841e-ca5220b0af63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.168378 Apr 05 11:16:52.906561 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 222/455] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:52 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:52.923470 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3c6ff694-1d2c-4e33-a55b-19ab874ad619 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:52.924103 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3c6ff694-1d2c-4e33-a55b-19ab874ad619 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:52.929948 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3c6ff694-1d2c-4e33-a55b-19ab874ad619 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:52.930391 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3c6ff694-1d2c-4e33-a55b-19ab874ad619 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:52.931172 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3c6ff694-1d2c-4e33-a55b-19ab874ad619 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:52.931604 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3c6ff694-1d2c-4e33-a55b-19ab874ad619 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:53.066578 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3c6ff694-1d2c-4e33-a55b-19ab874ad619 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:53.078084 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3c6ff694-1d2c-4e33-a55b-19ab874ad619 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:53.080158 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3c6ff694-1d2c-4e33-a55b-19ab874ad619 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:53.081552 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3c6ff694-1d2c-4e33-a55b-19ab874ad619 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1747 microversion: 2.20 time: 0.162597 Apr 05 11:16:53.091879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 234/456] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:52 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1747 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:53.746623 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8484078c-f276-435c-b018-c1691df69898 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:53.746623 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8484078c-f276-435c-b018-c1691df69898 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:53.754190 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8484078c-f276-435c-b018-c1691df69898 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:53.754668 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8484078c-f276-435c-b018-c1691df69898 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:53.755468 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8484078c-f276-435c-b018-c1691df69898 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:53.755886 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8484078c-f276-435c-b018-c1691df69898 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:53.822767 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:16:53.823025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: Tue Apr 5 11:16:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad (ip 10.222.0.39) !!! Apr 05 11:16:53.898598 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8484078c-f276-435c-b018-c1691df69898 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:53.906478 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8484078c-f276-435c-b018-c1691df69898 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.165805 Apr 05 11:16:53.907078 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 223/457] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:53 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:53.923109 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1af6062b-c748-4d98-9fde-a63c349184ac tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:53.923707 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1af6062b-c748-4d98-9fde-a63c349184ac tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:53.930252 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1af6062b-c748-4d98-9fde-a63c349184ac tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:53.930726 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1af6062b-c748-4d98-9fde-a63c349184ac tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:53.931484 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1af6062b-c748-4d98-9fde-a63c349184ac tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:53.931916 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1af6062b-c748-4d98-9fde-a63c349184ac tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:54.075859 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1af6062b-c748-4d98-9fde-a63c349184ac tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:54.083710 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1af6062b-c748-4d98-9fde-a63c349184ac tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.164856 Apr 05 11:16:54.084295 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 235/458] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:53 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:54.100463 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7c8fe7ac-0fb0-49ed-9eda-7f001458f03d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:54.101348 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7c8fe7ac-0fb0-49ed-9eda-7f001458f03d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:54.108403 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c8fe7ac-0fb0-49ed-9eda-7f001458f03d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:54.109067 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c8fe7ac-0fb0-49ed-9eda-7f001458f03d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:54.109879 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c8fe7ac-0fb0-49ed-9eda-7f001458f03d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:54.110312 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c8fe7ac-0fb0-49ed-9eda-7f001458f03d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:54.256584 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7c8fe7ac-0fb0-49ed-9eda-7f001458f03d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:54.267508 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7c8fe7ac-0fb0-49ed-9eda-7f001458f03d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:54.268973 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7c8fe7ac-0fb0-49ed-9eda-7f001458f03d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:54.270168 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7c8fe7ac-0fb0-49ed-9eda-7f001458f03d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1747 microversion: 2.20 time: 0.173573 Apr 05 11:16:54.270744 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 224/459] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:54 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1747 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:54.924465 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6271808d-4daf-43d5-96c5-971b845af200 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:54.925069 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6271808d-4daf-43d5-96c5-971b845af200 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:54.931616 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6271808d-4daf-43d5-96c5-971b845af200 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:54.932062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6271808d-4daf-43d5-96c5-971b845af200 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:54.932861 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6271808d-4daf-43d5-96c5-971b845af200 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:54.933293 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6271808d-4daf-43d5-96c5-971b845af200 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:55.066079 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6271808d-4daf-43d5-96c5-971b845af200 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:55.074316 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6271808d-4daf-43d5-96c5-971b845af200 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.154461 Apr 05 11:16:55.074988 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 236/460] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:54 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:55.100899 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-61e5fa44-533d-426d-8984-22fcca9dbf92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:55.101506 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-61e5fa44-533d-426d-8984-22fcca9dbf92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:55.107762 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-61e5fa44-533d-426d-8984-22fcca9dbf92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:55.108716 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-61e5fa44-533d-426d-8984-22fcca9dbf92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:55.109486 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-61e5fa44-533d-426d-8984-22fcca9dbf92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:55.109925 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-61e5fa44-533d-426d-8984-22fcca9dbf92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:55.246569 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-61e5fa44-533d-426d-8984-22fcca9dbf92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:55.254209 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-61e5fa44-533d-426d-8984-22fcca9dbf92 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.157040 Apr 05 11:16:55.254814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 225/461] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:55 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:55.289354 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-20288b0a-eacf-4734-befd-dfc57b1d4333 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:55.289950 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-20288b0a-eacf-4734-befd-dfc57b1d4333 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:55.296286 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-20288b0a-eacf-4734-befd-dfc57b1d4333 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:55.296728 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-20288b0a-eacf-4734-befd-dfc57b1d4333 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:55.297488 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-20288b0a-eacf-4734-befd-dfc57b1d4333 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:55.297914 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-20288b0a-eacf-4734-befd-dfc57b1d4333 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:55.429727 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-20288b0a-eacf-4734-befd-dfc57b1d4333 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:55.437586 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-20288b0a-eacf-4734-befd-dfc57b1d4333 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:55.439095 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-20288b0a-eacf-4734-befd-dfc57b1d4333 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:55.440230 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-20288b0a-eacf-4734-befd-dfc57b1d4333 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1747 microversion: 2.20 time: 0.154947 Apr 05 11:16:55.440998 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 237/462] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:55 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:56.098906 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cb5f72f0-9887-4c99-a33b-95921007c3ff tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:56.099514 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cb5f72f0-9887-4c99-a33b-95921007c3ff tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:56.105860 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cb5f72f0-9887-4c99-a33b-95921007c3ff tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:56.106487 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cb5f72f0-9887-4c99-a33b-95921007c3ff tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:56.107084 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cb5f72f0-9887-4c99-a33b-95921007c3ff tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:56.107514 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cb5f72f0-9887-4c99-a33b-95921007c3ff tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:56.241711 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cb5f72f0-9887-4c99-a33b-95921007c3ff tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:56.250428 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cb5f72f0-9887-4c99-a33b-95921007c3ff tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.155429 Apr 05 11:16:56.252577 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 226/463] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:56 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:56.270559 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-090a5ccd-fab8-47ea-bec1-7e66c92e74a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:56.271227 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-090a5ccd-fab8-47ea-bec1-7e66c92e74a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:56.277572 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-090a5ccd-fab8-47ea-bec1-7e66c92e74a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:56.278024 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-090a5ccd-fab8-47ea-bec1-7e66c92e74a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:56.278836 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-090a5ccd-fab8-47ea-bec1-7e66c92e74a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:56.279305 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-090a5ccd-fab8-47ea-bec1-7e66c92e74a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:56.411060 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-090a5ccd-fab8-47ea-bec1-7e66c92e74a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:56.418447 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-090a5ccd-fab8-47ea-bec1-7e66c92e74a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.151808 Apr 05 11:16:56.419050 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 238/464] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:56 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:56.458518 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d49c0063-37e0-4f26-ad27-94162176fbe3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:56.459149 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d49c0063-37e0-4f26-ad27-94162176fbe3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:56.464881 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d49c0063-37e0-4f26-ad27-94162176fbe3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:56.465327 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d49c0063-37e0-4f26-ad27-94162176fbe3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:56.466084 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d49c0063-37e0-4f26-ad27-94162176fbe3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:56.466512 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d49c0063-37e0-4f26-ad27-94162176fbe3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:56.600886 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d49c0063-37e0-4f26-ad27-94162176fbe3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:56.608672 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d49c0063-37e0-4f26-ad27-94162176fbe3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:56.610255 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d49c0063-37e0-4f26-ad27-94162176fbe3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:56.611427 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d49c0063-37e0-4f26-ad27-94162176fbe3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1747 microversion: 2.20 time: 0.156753 Apr 05 11:16:56.611995 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 227/465] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:56 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:57.267877 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e273187e-f9a9-4a57-91de-902feeb3c012 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:57.268561 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e273187e-f9a9-4a57-91de-902feeb3c012 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:57.274279 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e273187e-f9a9-4a57-91de-902feeb3c012 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:57.274945 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e273187e-f9a9-4a57-91de-902feeb3c012 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:57.275499 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e273187e-f9a9-4a57-91de-902feeb3c012 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:57.275927 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e273187e-f9a9-4a57-91de-902feeb3c012 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:57.410925 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e273187e-f9a9-4a57-91de-902feeb3c012 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:57.418740 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e273187e-f9a9-4a57-91de-902feeb3c012 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.154712 Apr 05 11:16:57.419303 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 239/466] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:57 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:57.434894 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cfdd8a19-39e3-429b-bfcf-fc3a87e8ac2c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:57.435503 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cfdd8a19-39e3-429b-bfcf-fc3a87e8ac2c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:57.441879 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cfdd8a19-39e3-429b-bfcf-fc3a87e8ac2c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:57.442330 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cfdd8a19-39e3-429b-bfcf-fc3a87e8ac2c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:57.443195 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cfdd8a19-39e3-429b-bfcf-fc3a87e8ac2c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:57.443634 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cfdd8a19-39e3-429b-bfcf-fc3a87e8ac2c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:57.575093 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cfdd8a19-39e3-429b-bfcf-fc3a87e8ac2c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:57.583384 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cfdd8a19-39e3-429b-bfcf-fc3a87e8ac2c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.152323 Apr 05 11:16:57.589185 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 228/467] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:57 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:57.629081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-29ff7b94-f67a-4058-bdbd-bb5c1f587580 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:57.629680 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-29ff7b94-f67a-4058-bdbd-bb5c1f587580 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:57.635503 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29ff7b94-f67a-4058-bdbd-bb5c1f587580 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:57.635947 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29ff7b94-f67a-4058-bdbd-bb5c1f587580 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:57.636730 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29ff7b94-f67a-4058-bdbd-bb5c1f587580 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:57.637158 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29ff7b94-f67a-4058-bdbd-bb5c1f587580 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:57.770625 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-29ff7b94-f67a-4058-bdbd-bb5c1f587580 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:57.778164 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-29ff7b94-f67a-4058-bdbd-bb5c1f587580 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:57.779798 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-29ff7b94-f67a-4058-bdbd-bb5c1f587580 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:57.780956 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-29ff7b94-f67a-4058-bdbd-bb5c1f587580 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1747 microversion: 2.20 time: 0.155762 Apr 05 11:16:57.782220 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 240/468] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:57 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:58.435760 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ac11c48a-20a6-405b-9c47-6cf191ca0cd1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:58.436300 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ac11c48a-20a6-405b-9c47-6cf191ca0cd1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:58.442579 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ac11c48a-20a6-405b-9c47-6cf191ca0cd1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:58.443054 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ac11c48a-20a6-405b-9c47-6cf191ca0cd1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:58.443816 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ac11c48a-20a6-405b-9c47-6cf191ca0cd1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:58.444249 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ac11c48a-20a6-405b-9c47-6cf191ca0cd1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:58.575474 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ac11c48a-20a6-405b-9c47-6cf191ca0cd1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:58.583459 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ac11c48a-20a6-405b-9c47-6cf191ca0cd1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.151553 Apr 05 11:16:58.584057 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 229/469] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:58 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:58.600594 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2f078312-5b79-4306-ad70-42fbbd0cfc9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:58.601210 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2f078312-5b79-4306-ad70-42fbbd0cfc9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:58.608285 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2f078312-5b79-4306-ad70-42fbbd0cfc9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:58.608758 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2f078312-5b79-4306-ad70-42fbbd0cfc9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:58.610196 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2f078312-5b79-4306-ad70-42fbbd0cfc9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:58.610655 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2f078312-5b79-4306-ad70-42fbbd0cfc9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:58.743129 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2f078312-5b79-4306-ad70-42fbbd0cfc9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:58.750690 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2f078312-5b79-4306-ad70-42fbbd0cfc9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.153950 Apr 05 11:16:58.751270 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 241/470] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:58 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:58.800368 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5c5cf9c6-8a24-45a8-a2d6-4e24b27a9290 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:58.800970 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5c5cf9c6-8a24-45a8-a2d6-4e24b27a9290 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:58.807059 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c5cf9c6-8a24-45a8-a2d6-4e24b27a9290 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:58.807501 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c5cf9c6-8a24-45a8-a2d6-4e24b27a9290 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:58.808263 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c5cf9c6-8a24-45a8-a2d6-4e24b27a9290 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:58.808694 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c5cf9c6-8a24-45a8-a2d6-4e24b27a9290 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:59.135100 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5c5cf9c6-8a24-45a8-a2d6-4e24b27a9290 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:59.135100 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5c5cf9c6-8a24-45a8-a2d6-4e24b27a9290 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:59.135475 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5c5cf9c6-8a24-45a8-a2d6-4e24b27a9290 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:59.135475 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5c5cf9c6-8a24-45a8-a2d6-4e24b27a9290 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1747 microversion: 2.20 time: 0.158617 Apr 05 11:16:59.135475 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 230/471] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:58 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:16:59.601164 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ba2efbac-3818-4e70-af51-24e3054940ed tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:59.601773 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ba2efbac-3818-4e70-af51-24e3054940ed tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:59.608098 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ba2efbac-3818-4e70-af51-24e3054940ed tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:59.608543 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ba2efbac-3818-4e70-af51-24e3054940ed tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:59.609296 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ba2efbac-3818-4e70-af51-24e3054940ed tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:59.609761 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ba2efbac-3818-4e70-af51-24e3054940ed tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:59.744535 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ba2efbac-3818-4e70-af51-24e3054940ed tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:59.752958 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ba2efbac-3818-4e70-af51-24e3054940ed tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.155726 Apr 05 11:16:59.753510 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 242/472] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:59 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:59.767967 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-674c5a16-3ffa-496e-8f3a-11255255036e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:59.768595 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-674c5a16-3ffa-496e-8f3a-11255255036e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:59.774873 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-674c5a16-3ffa-496e-8f3a-11255255036e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:59.775329 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-674c5a16-3ffa-496e-8f3a-11255255036e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:59.776097 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-674c5a16-3ffa-496e-8f3a-11255255036e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:59.776535 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-674c5a16-3ffa-496e-8f3a-11255255036e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:59.910413 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-674c5a16-3ffa-496e-8f3a-11255255036e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:16:59.917802 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-674c5a16-3ffa-496e-8f3a-11255255036e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.154263 Apr 05 11:16:59.918363 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 231/473] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:16:59 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:16:59.973278 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8ea32873-17d6-44a9-9eb0-b6d066307f2a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:16:59.973883 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8ea32873-17d6-44a9-9eb0-b6d066307f2a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:16:59.980640 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ea32873-17d6-44a9-9eb0-b6d066307f2a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:59.981202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ea32873-17d6-44a9-9eb0-b6d066307f2a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:16:59.982242 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ea32873-17d6-44a9-9eb0-b6d066307f2a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:16:59.982716 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ea32873-17d6-44a9-9eb0-b6d066307f2a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:00.114850 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8ea32873-17d6-44a9-9eb0-b6d066307f2a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:00.122917 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8ea32873-17d6-44a9-9eb0-b6d066307f2a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:00.124415 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8ea32873-17d6-44a9-9eb0-b6d066307f2a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:00.125679 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8ea32873-17d6-44a9-9eb0-b6d066307f2a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1747 microversion: 2.20 time: 0.156918 Apr 05 11:17:00.126258 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 243/474] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:16:59 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:00.770198 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cd26a3aa-232e-470c-a831-097cccf99e94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:00.770840 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cd26a3aa-232e-470c-a831-097cccf99e94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:00.777862 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd26a3aa-232e-470c-a831-097cccf99e94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:00.778405 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd26a3aa-232e-470c-a831-097cccf99e94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:00.779398 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd26a3aa-232e-470c-a831-097cccf99e94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:00.780054 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd26a3aa-232e-470c-a831-097cccf99e94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:00.920420 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cd26a3aa-232e-470c-a831-097cccf99e94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:00.931579 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cd26a3aa-232e-470c-a831-097cccf99e94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.165836 Apr 05 11:17:00.932194 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 232/475] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:00 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:00.935035 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-971b1538-c580-41e6-a59d-1be2f4541e04 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:00.935648 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-971b1538-c580-41e6-a59d-1be2f4541e04 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:00.943081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-971b1538-c580-41e6-a59d-1be2f4541e04 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:00.943534 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-971b1538-c580-41e6-a59d-1be2f4541e04 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:00.944349 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-971b1538-c580-41e6-a59d-1be2f4541e04 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:00.944786 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-971b1538-c580-41e6-a59d-1be2f4541e04 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:01.086549 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-971b1538-c580-41e6-a59d-1be2f4541e04 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:01.093977 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-971b1538-c580-41e6-a59d-1be2f4541e04 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.162814 Apr 05 11:17:01.094538 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 244/476] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:00 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:01.143887 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1154867f-7ab6-4878-a65d-62ac1a8e5ff2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:01.144492 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1154867f-7ab6-4878-a65d-62ac1a8e5ff2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:01.150414 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1154867f-7ab6-4878-a65d-62ac1a8e5ff2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:01.150898 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1154867f-7ab6-4878-a65d-62ac1a8e5ff2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:01.151665 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1154867f-7ab6-4878-a65d-62ac1a8e5ff2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:01.152103 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1154867f-7ab6-4878-a65d-62ac1a8e5ff2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:01.286815 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1154867f-7ab6-4878-a65d-62ac1a8e5ff2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:01.297305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1154867f-7ab6-4878-a65d-62ac1a8e5ff2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:01.297305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1154867f-7ab6-4878-a65d-62ac1a8e5ff2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:01.298071 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1154867f-7ab6-4878-a65d-62ac1a8e5ff2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1747 microversion: 2.20 time: 0.157469 Apr 05 11:17:01.298276 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 233/477] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:01 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:01.949368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-28bccbf4-6ec4-4d7e-ad1d-95b1d36db2a0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:01.949974 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-28bccbf4-6ec4-4d7e-ad1d-95b1d36db2a0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:01.957043 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-28bccbf4-6ec4-4d7e-ad1d-95b1d36db2a0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:01.957497 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-28bccbf4-6ec4-4d7e-ad1d-95b1d36db2a0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:01.958285 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-28bccbf4-6ec4-4d7e-ad1d-95b1d36db2a0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:01.958755 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-28bccbf4-6ec4-4d7e-ad1d-95b1d36db2a0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:02.099288 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-28bccbf4-6ec4-4d7e-ad1d-95b1d36db2a0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:02.107214 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-28bccbf4-6ec4-4d7e-ad1d-95b1d36db2a0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.161801 Apr 05 11:17:02.107811 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 245/478] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:01 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:02.110009 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ca5e3e8b-1dfd-4d86-98ca-4bdd90d30948 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:02.110634 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ca5e3e8b-1dfd-4d86-98ca-4bdd90d30948 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:02.116868 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca5e3e8b-1dfd-4d86-98ca-4bdd90d30948 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:02.117305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca5e3e8b-1dfd-4d86-98ca-4bdd90d30948 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:02.118104 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca5e3e8b-1dfd-4d86-98ca-4bdd90d30948 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:02.118511 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca5e3e8b-1dfd-4d86-98ca-4bdd90d30948 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:02.250714 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ca5e3e8b-1dfd-4d86-98ca-4bdd90d30948 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:02.259013 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ca5e3e8b-1dfd-4d86-98ca-4bdd90d30948 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1500 microversion: 2.1 time: 0.152642 Apr 05 11:17:02.269325 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 234/479] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:02 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1500 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:02.276209 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1b298c53-0059-47a7-be9f-1173bb094ee1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6946af0-77ce-4237-949d-38776fc94ba1"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:02.277386 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1b298c53-0059-47a7-be9f-1173bb094ee1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:02.283531 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b298c53-0059-47a7-be9f-1173bb094ee1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:02.283983 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b298c53-0059-47a7-be9f-1173bb094ee1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:02.284812 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b298c53-0059-47a7-be9f-1173bb094ee1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:02.285253 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b298c53-0059-47a7-be9f-1173bb094ee1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:02.310139 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-1b298c53-0059-47a7-be9f-1173bb094ee1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] HTTP exception thrown: Cannot 'attach_volume' instance e8f4506a-1e74-4699-938c-1fe000c3d0e7 while it is in vm_state rescued Apr 05 11:17:02.310702 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1b298c53-0059-47a7-be9f-1173bb094ee1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Returning 409 to user: Cannot 'attach_volume' instance e8f4506a-1e74-4699-938c-1fe000c3d0e7 while it is in vm_state rescued {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:17:02.311490 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1b298c53-0059-47a7-be9f-1173bb094ee1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "POST /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039492 Apr 05 11:17:02.312049 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 246/480] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:17:02 2022] POST /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 05 11:17:02.316457 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-429c2506-cc87-4346-9649-89fd9ccc11cc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:02.317088 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-429c2506-cc87-4346-9649-89fd9ccc11cc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:02.321642 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7dba6c75-2f49-41fa-a540-d7d0c248bf72 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:02.322575 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7dba6c75-2f49-41fa-a540-d7d0c248bf72 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:02.330641 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7dba6c75-2f49-41fa-a540-d7d0c248bf72 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:02.330947 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7dba6c75-2f49-41fa-a540-d7d0c248bf72 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:02.331793 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-429c2506-cc87-4346-9649-89fd9ccc11cc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:02.331919 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7dba6c75-2f49-41fa-a540-d7d0c248bf72 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:02.332278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-429c2506-cc87-4346-9649-89fd9ccc11cc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:02.332397 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7dba6c75-2f49-41fa-a540-d7d0c248bf72 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:02.335958 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-429c2506-cc87-4346-9649-89fd9ccc11cc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:02.335958 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-429c2506-cc87-4346-9649-89fd9ccc11cc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:02.479285 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-429c2506-cc87-4346-9649-89fd9ccc11cc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:02.487693 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-429c2506-cc87-4346-9649-89fd9ccc11cc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:02.489187 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-429c2506-cc87-4346-9649-89fd9ccc11cc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:02.490338 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-429c2506-cc87-4346-9649-89fd9ccc11cc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1747 microversion: 2.20 time: 0.178550 Apr 05 11:17:02.490940 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 235/481] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:02 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1747 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:02.772589 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7dba6c75-2f49-41fa-a540-d7d0c248bf72 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "POST /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7/action" status: 202 len: 0 microversion: 2.1 time: 0.455185 Apr 05 11:17:02.773575 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 247/482] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:17:02 2022] POST /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:17:02.782009 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a00f3a67-94cf-4056-9d13-f9cccc506c58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:02.782565 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a00f3a67-94cf-4056-9d13-f9cccc506c58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:02.788967 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a00f3a67-94cf-4056-9d13-f9cccc506c58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:02.789401 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a00f3a67-94cf-4056-9d13-f9cccc506c58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:02.790181 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a00f3a67-94cf-4056-9d13-f9cccc506c58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:02.790704 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a00f3a67-94cf-4056-9d13-f9cccc506c58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:02.932622 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a00f3a67-94cf-4056-9d13-f9cccc506c58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:02.940748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a00f3a67-94cf-4056-9d13-f9cccc506c58 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.162409 Apr 05 11:17:02.941459 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 236/483] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:02 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:03.125934 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d06470a1-785d-4bd5-8631-2f702cc10bb7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:03.127069 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d06470a1-785d-4bd5-8631-2f702cc10bb7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:03.134231 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d06470a1-785d-4bd5-8631-2f702cc10bb7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:03.135019 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d06470a1-785d-4bd5-8631-2f702cc10bb7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:03.135799 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d06470a1-785d-4bd5-8631-2f702cc10bb7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:03.136262 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d06470a1-785d-4bd5-8631-2f702cc10bb7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:03.325381 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d06470a1-785d-4bd5-8631-2f702cc10bb7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:03.329360 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d06470a1-785d-4bd5-8631-2f702cc10bb7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.208650 Apr 05 11:17:03.329913 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 248/484] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:03 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:03.513157 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-78919ef8-057f-492b-8595-53dc6c7556af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:03.515082 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-78919ef8-057f-492b-8595-53dc6c7556af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:03.526999 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-78919ef8-057f-492b-8595-53dc6c7556af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:03.527807 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-78919ef8-057f-492b-8595-53dc6c7556af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:03.532199 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-78919ef8-057f-492b-8595-53dc6c7556af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:03.532999 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-78919ef8-057f-492b-8595-53dc6c7556af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:03.680648 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-78919ef8-057f-492b-8595-53dc6c7556af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:03.688992 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-78919ef8-057f-492b-8595-53dc6c7556af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:03.690572 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-78919ef8-057f-492b-8595-53dc6c7556af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:03.691856 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-78919ef8-057f-492b-8595-53dc6c7556af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1747 microversion: 2.20 time: 0.184716 Apr 05 11:17:03.692421 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 237/485] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:03 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1747 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:03.958681 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7aefb50a-90b9-4fae-86c3-536c9e6c97ee tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:03.959259 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7aefb50a-90b9-4fae-86c3-536c9e6c97ee tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:03.965980 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7aefb50a-90b9-4fae-86c3-536c9e6c97ee tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:03.966459 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7aefb50a-90b9-4fae-86c3-536c9e6c97ee tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:03.967257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7aefb50a-90b9-4fae-86c3-536c9e6c97ee tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:03.967692 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7aefb50a-90b9-4fae-86c3-536c9e6c97ee tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:04.110130 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7aefb50a-90b9-4fae-86c3-536c9e6c97ee tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:04.117620 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7aefb50a-90b9-4fae-86c3-536c9e6c97ee tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.163268 Apr 05 11:17:04.118238 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 249/486] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:03 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:04.345471 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e135e551-0fa0-493d-9daf-c61f2552f307 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:04.346080 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e135e551-0fa0-493d-9daf-c61f2552f307 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:04.352306 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e135e551-0fa0-493d-9daf-c61f2552f307 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:04.352761 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e135e551-0fa0-493d-9daf-c61f2552f307 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:04.353530 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e135e551-0fa0-493d-9daf-c61f2552f307 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:04.353968 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e135e551-0fa0-493d-9daf-c61f2552f307 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:04.497082 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e135e551-0fa0-493d-9daf-c61f2552f307 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:04.505596 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e135e551-0fa0-493d-9daf-c61f2552f307 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.163986 Apr 05 11:17:04.506159 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 238/487] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:04 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:04.709866 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3c9c70ef-d9a7-4314-a516-eeb17c2afb67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:04.710470 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3c9c70ef-d9a7-4314-a516-eeb17c2afb67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:04.716662 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3c9c70ef-d9a7-4314-a516-eeb17c2afb67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:04.717108 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3c9c70ef-d9a7-4314-a516-eeb17c2afb67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:04.717866 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3c9c70ef-d9a7-4314-a516-eeb17c2afb67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:04.718293 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3c9c70ef-d9a7-4314-a516-eeb17c2afb67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:04.852289 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3c9c70ef-d9a7-4314-a516-eeb17c2afb67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:04.859988 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3c9c70ef-d9a7-4314-a516-eeb17c2afb67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:04.861480 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3c9c70ef-d9a7-4314-a516-eeb17c2afb67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:04.862629 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3c9c70ef-d9a7-4314-a516-eeb17c2afb67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.156674 Apr 05 11:17:04.863191 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 250/488] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:04 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:05.135425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8cf7aff4-b2f7-4a63-bdaf-1881ea3994d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:05.136027 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8cf7aff4-b2f7-4a63-bdaf-1881ea3994d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:05.142256 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8cf7aff4-b2f7-4a63-bdaf-1881ea3994d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:05.142738 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8cf7aff4-b2f7-4a63-bdaf-1881ea3994d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:05.143503 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8cf7aff4-b2f7-4a63-bdaf-1881ea3994d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:05.143940 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8cf7aff4-b2f7-4a63-bdaf-1881ea3994d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:05.283594 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8cf7aff4-b2f7-4a63-bdaf-1881ea3994d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:05.291885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8cf7aff4-b2f7-4a63-bdaf-1881ea3994d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.160245 Apr 05 11:17:05.292454 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 239/489] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:05 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:05.523461 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5846e650-e428-4d40-b68d-d6454c8a8877 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:05.524045 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5846e650-e428-4d40-b68d-d6454c8a8877 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:05.530161 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5846e650-e428-4d40-b68d-d6454c8a8877 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:05.530639 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5846e650-e428-4d40-b68d-d6454c8a8877 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:05.531436 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5846e650-e428-4d40-b68d-d6454c8a8877 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:05.531867 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5846e650-e428-4d40-b68d-d6454c8a8877 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:05.670040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5846e650-e428-4d40-b68d-d6454c8a8877 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:05.678013 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5846e650-e428-4d40-b68d-d6454c8a8877 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.159046 Apr 05 11:17:05.678578 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 251/490] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:05 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:05.883723 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-71e10646-4770-496e-98ba-9d12a9eb7f0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:05.884541 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-71e10646-4770-496e-98ba-9d12a9eb7f0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:05.890497 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-71e10646-4770-496e-98ba-9d12a9eb7f0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:05.890978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-71e10646-4770-496e-98ba-9d12a9eb7f0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:05.891747 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-71e10646-4770-496e-98ba-9d12a9eb7f0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:05.892174 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-71e10646-4770-496e-98ba-9d12a9eb7f0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:06.025324 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-71e10646-4770-496e-98ba-9d12a9eb7f0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:06.033405 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-71e10646-4770-496e-98ba-9d12a9eb7f0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:06.035099 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-71e10646-4770-496e-98ba-9d12a9eb7f0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:06.036471 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-71e10646-4770-496e-98ba-9d12a9eb7f0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.158507 Apr 05 11:17:06.037222 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 240/491] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:05 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:17:06.309407 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0da49f48-3d77-4555-9c21-58b90c299559 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:06.310050 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0da49f48-3d77-4555-9c21-58b90c299559 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:06.316487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0da49f48-3d77-4555-9c21-58b90c299559 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:06.316961 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0da49f48-3d77-4555-9c21-58b90c299559 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:06.317743 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0da49f48-3d77-4555-9c21-58b90c299559 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:06.318177 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0da49f48-3d77-4555-9c21-58b90c299559 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:06.449210 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0da49f48-3d77-4555-9c21-58b90c299559 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:06.456467 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0da49f48-3d77-4555-9c21-58b90c299559 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.151044 Apr 05 11:17:06.457038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 252/492] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:06 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:06.695259 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b377ec2f-f09b-495b-9a0f-f579b6edd77a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:06.695872 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b377ec2f-f09b-495b-9a0f-f579b6edd77a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:06.702161 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b377ec2f-f09b-495b-9a0f-f579b6edd77a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:06.702632 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b377ec2f-f09b-495b-9a0f-f579b6edd77a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:06.703408 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b377ec2f-f09b-495b-9a0f-f579b6edd77a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:06.703842 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b377ec2f-f09b-495b-9a0f-f579b6edd77a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:06.847489 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b377ec2f-f09b-495b-9a0f-f579b6edd77a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:06.855899 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b377ec2f-f09b-495b-9a0f-f579b6edd77a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.164454 Apr 05 11:17:06.856469 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 241/493] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:06 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:07.055393 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-db46e9ae-a177-4109-bfcf-8e650f9b1dc0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:07.055949 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-db46e9ae-a177-4109-bfcf-8e650f9b1dc0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:07.062032 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db46e9ae-a177-4109-bfcf-8e650f9b1dc0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:07.062488 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db46e9ae-a177-4109-bfcf-8e650f9b1dc0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:07.063310 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db46e9ae-a177-4109-bfcf-8e650f9b1dc0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:07.063753 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db46e9ae-a177-4109-bfcf-8e650f9b1dc0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:07.199197 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db46e9ae-a177-4109-bfcf-8e650f9b1dc0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:07.207380 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db46e9ae-a177-4109-bfcf-8e650f9b1dc0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:07.208899 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db46e9ae-a177-4109-bfcf-8e650f9b1dc0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:07.210751 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-db46e9ae-a177-4109-bfcf-8e650f9b1dc0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.158917 Apr 05 11:17:07.211309 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 253/494] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:07 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:07.474496 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-75e6d781-0b02-4b6f-b268-2de0964a9b9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:07.475137 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-75e6d781-0b02-4b6f-b268-2de0964a9b9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:07.481189 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75e6d781-0b02-4b6f-b268-2de0964a9b9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:07.481637 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75e6d781-0b02-4b6f-b268-2de0964a9b9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:07.482410 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75e6d781-0b02-4b6f-b268-2de0964a9b9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:07.482878 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75e6d781-0b02-4b6f-b268-2de0964a9b9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:07.613672 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-75e6d781-0b02-4b6f-b268-2de0964a9b9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:07.621774 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-75e6d781-0b02-4b6f-b268-2de0964a9b9f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.152205 Apr 05 11:17:07.622344 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 242/495] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:07 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:07.873095 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d262ca6a-8739-4453-8745-687a583ee2cf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:07.873743 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d262ca6a-8739-4453-8745-687a583ee2cf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:07.880228 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d262ca6a-8739-4453-8745-687a583ee2cf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:07.880678 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d262ca6a-8739-4453-8745-687a583ee2cf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:07.881443 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d262ca6a-8739-4453-8745-687a583ee2cf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:07.881869 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d262ca6a-8739-4453-8745-687a583ee2cf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:08.028689 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d262ca6a-8739-4453-8745-687a583ee2cf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:08.036368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d262ca6a-8739-4453-8745-687a583ee2cf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.167326 Apr 05 11:17:08.036929 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 254/496] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:07 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:08.229681 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7c049d75-8692-440a-9b3c-0bb3f1d41519 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:08.230338 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7c049d75-8692-440a-9b3c-0bb3f1d41519 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:08.236691 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c049d75-8692-440a-9b3c-0bb3f1d41519 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:08.237135 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c049d75-8692-440a-9b3c-0bb3f1d41519 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:08.237901 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c049d75-8692-440a-9b3c-0bb3f1d41519 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:08.238330 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c049d75-8692-440a-9b3c-0bb3f1d41519 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:08.373584 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7c049d75-8692-440a-9b3c-0bb3f1d41519 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:08.382949 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7c049d75-8692-440a-9b3c-0bb3f1d41519 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:08.384722 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7c049d75-8692-440a-9b3c-0bb3f1d41519 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:08.386062 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7c049d75-8692-440a-9b3c-0bb3f1d41519 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.160877 Apr 05 11:17:08.386660 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 243/497] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:08 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:08.639734 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f0b683b8-b69d-4828-af3d-7116a25d3f8f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:08.640258 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f0b683b8-b69d-4828-af3d-7116a25d3f8f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:08.646353 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0b683b8-b69d-4828-af3d-7116a25d3f8f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:08.646849 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0b683b8-b69d-4828-af3d-7116a25d3f8f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:08.647637 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0b683b8-b69d-4828-af3d-7116a25d3f8f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:08.648073 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0b683b8-b69d-4828-af3d-7116a25d3f8f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:08.777580 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f0b683b8-b69d-4828-af3d-7116a25d3f8f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:08.784893 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f0b683b8-b69d-4828-af3d-7116a25d3f8f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.149163 Apr 05 11:17:08.785454 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 255/498] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:08 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:09.055618 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ae1f6058-f19e-465e-a905-e6fff9e70d32 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:09.056852 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ae1f6058-f19e-465e-a905-e6fff9e70d32 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:09.063222 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae1f6058-f19e-465e-a905-e6fff9e70d32 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:09.063698 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae1f6058-f19e-465e-a905-e6fff9e70d32 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:09.064498 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae1f6058-f19e-465e-a905-e6fff9e70d32 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:09.064936 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae1f6058-f19e-465e-a905-e6fff9e70d32 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:09.202137 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ae1f6058-f19e-465e-a905-e6fff9e70d32 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:09.211760 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ae1f6058-f19e-465e-a905-e6fff9e70d32 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.160026 Apr 05 11:17:09.212367 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 244/499] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:09 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:09.404663 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8c6da247-ad52-476a-bb8e-9dc091fe6b95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:09.405325 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8c6da247-ad52-476a-bb8e-9dc091fe6b95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:09.411766 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8c6da247-ad52-476a-bb8e-9dc091fe6b95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:09.412217 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8c6da247-ad52-476a-bb8e-9dc091fe6b95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:09.412980 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8c6da247-ad52-476a-bb8e-9dc091fe6b95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:09.413492 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8c6da247-ad52-476a-bb8e-9dc091fe6b95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:09.549090 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8c6da247-ad52-476a-bb8e-9dc091fe6b95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:09.558254 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8c6da247-ad52-476a-bb8e-9dc091fe6b95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:09.560126 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8c6da247-ad52-476a-bb8e-9dc091fe6b95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:09.561304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8c6da247-ad52-476a-bb8e-9dc091fe6b95 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.160753 Apr 05 11:17:09.561870 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 256/500] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:09 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:09.802065 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-250dec99-85e5-4638-ae71-0f98cac476f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:09.802712 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-250dec99-85e5-4638-ae71-0f98cac476f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:09.809057 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-250dec99-85e5-4638-ae71-0f98cac476f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:09.809509 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-250dec99-85e5-4638-ae71-0f98cac476f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:09.810341 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-250dec99-85e5-4638-ae71-0f98cac476f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:09.810760 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-250dec99-85e5-4638-ae71-0f98cac476f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:09.954472 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-250dec99-85e5-4638-ae71-0f98cac476f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:09.961852 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-250dec99-85e5-4638-ae71-0f98cac476f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.163714 Apr 05 11:17:09.963160 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 245/501] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:09 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:10.229118 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b5570a56-47d5-4ef8-ab38-3074fe5d409b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:10.229724 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b5570a56-47d5-4ef8-ab38-3074fe5d409b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:10.235607 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5570a56-47d5-4ef8-ab38-3074fe5d409b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:10.236052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5570a56-47d5-4ef8-ab38-3074fe5d409b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:10.236805 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5570a56-47d5-4ef8-ab38-3074fe5d409b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:10.237228 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5570a56-47d5-4ef8-ab38-3074fe5d409b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:10.371700 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b5570a56-47d5-4ef8-ab38-3074fe5d409b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:10.379329 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b5570a56-47d5-4ef8-ab38-3074fe5d409b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.154094 Apr 05 11:17:10.379893 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 257/502] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:10 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:10.578971 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ba6d95e8-12a7-4b6b-bac8-e2d56160fe7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:10.579620 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ba6d95e8-12a7-4b6b-bac8-e2d56160fe7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:10.585436 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ba6d95e8-12a7-4b6b-bac8-e2d56160fe7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:10.585881 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ba6d95e8-12a7-4b6b-bac8-e2d56160fe7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:10.586652 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ba6d95e8-12a7-4b6b-bac8-e2d56160fe7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:10.587088 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ba6d95e8-12a7-4b6b-bac8-e2d56160fe7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:10.718416 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ba6d95e8-12a7-4b6b-bac8-e2d56160fe7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:10.726259 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ba6d95e8-12a7-4b6b-bac8-e2d56160fe7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:10.728346 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ba6d95e8-12a7-4b6b-bac8-e2d56160fe7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:10.729481 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ba6d95e8-12a7-4b6b-bac8-e2d56160fe7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.154491 Apr 05 11:17:10.730045 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 246/503] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:10 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:10.979823 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-979db895-20cd-431d-abd9-2ef4d1a3de15 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:10.980456 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-979db895-20cd-431d-abd9-2ef4d1a3de15 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:10.987013 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-979db895-20cd-431d-abd9-2ef4d1a3de15 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:10.987666 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-979db895-20cd-431d-abd9-2ef4d1a3de15 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:10.988443 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-979db895-20cd-431d-abd9-2ef4d1a3de15 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:10.988913 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-979db895-20cd-431d-abd9-2ef4d1a3de15 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:11.121294 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-979db895-20cd-431d-abd9-2ef4d1a3de15 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:11.128844 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-979db895-20cd-431d-abd9-2ef4d1a3de15 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.153541 Apr 05 11:17:11.129432 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 258/504] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:10 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:11.397104 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b1340410-0ef8-4f97-a2fe-9cd0caaf8ddc tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:11.397714 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b1340410-0ef8-4f97-a2fe-9cd0caaf8ddc tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:11.404922 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b1340410-0ef8-4f97-a2fe-9cd0caaf8ddc tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:11.409242 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b1340410-0ef8-4f97-a2fe-9cd0caaf8ddc tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:11.409242 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b1340410-0ef8-4f97-a2fe-9cd0caaf8ddc tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:11.409242 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b1340410-0ef8-4f97-a2fe-9cd0caaf8ddc tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:11.545864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b1340410-0ef8-4f97-a2fe-9cd0caaf8ddc tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:11.553784 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b1340410-0ef8-4f97-a2fe-9cd0caaf8ddc tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.160688 Apr 05 11:17:11.554342 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 247/505] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:11 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:11.748221 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-87e50b11-9a25-412f-b30e-b97348e12e8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:11.748814 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-87e50b11-9a25-412f-b30e-b97348e12e8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:11.754691 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-87e50b11-9a25-412f-b30e-b97348e12e8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:11.755133 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-87e50b11-9a25-412f-b30e-b97348e12e8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:11.759425 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-87e50b11-9a25-412f-b30e-b97348e12e8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:11.759425 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-87e50b11-9a25-412f-b30e-b97348e12e8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:11.898590 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-87e50b11-9a25-412f-b30e-b97348e12e8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:11.906469 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-87e50b11-9a25-412f-b30e-b97348e12e8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:11.908212 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-87e50b11-9a25-412f-b30e-b97348e12e8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:11.909441 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-87e50b11-9a25-412f-b30e-b97348e12e8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.165521 Apr 05 11:17:11.910022 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 259/506] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:11 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:12.145621 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7084dfaa-b250-470e-809b-c73c14ef01d1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:12.146223 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7084dfaa-b250-470e-809b-c73c14ef01d1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:12.152846 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7084dfaa-b250-470e-809b-c73c14ef01d1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:12.153304 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7084dfaa-b250-470e-809b-c73c14ef01d1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:12.154067 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7084dfaa-b250-470e-809b-c73c14ef01d1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:12.154499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7084dfaa-b250-470e-809b-c73c14ef01d1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:12.293347 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7084dfaa-b250-470e-809b-c73c14ef01d1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:12.300527 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7084dfaa-b250-470e-809b-c73c14ef01d1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.158786 Apr 05 11:17:12.301151 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 248/507] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:12 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:12.572155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c8b1dd78-6a01-4c2f-ac4e-51949c52fadd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:12.572703 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c8b1dd78-6a01-4c2f-ac4e-51949c52fadd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:12.578921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8b1dd78-6a01-4c2f-ac4e-51949c52fadd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:12.579376 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8b1dd78-6a01-4c2f-ac4e-51949c52fadd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:12.580141 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8b1dd78-6a01-4c2f-ac4e-51949c52fadd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:12.580575 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8b1dd78-6a01-4c2f-ac4e-51949c52fadd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:12.714761 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c8b1dd78-6a01-4c2f-ac4e-51949c52fadd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:12.722663 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c8b1dd78-6a01-4c2f-ac4e-51949c52fadd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.155427 Apr 05 11:17:12.723223 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 260/508] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:12 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:12.927913 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1d160c35-5ec0-43d0-b7b4-c32af88d2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:12.928430 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1d160c35-5ec0-43d0-b7b4-c32af88d2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:12.935209 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d160c35-5ec0-43d0-b7b4-c32af88d2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:12.935654 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d160c35-5ec0-43d0-b7b4-c32af88d2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:12.936408 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d160c35-5ec0-43d0-b7b4-c32af88d2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:12.936888 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d160c35-5ec0-43d0-b7b4-c32af88d2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:13.070784 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1d160c35-5ec0-43d0-b7b4-c32af88d2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:13.079194 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1d160c35-5ec0-43d0-b7b4-c32af88d2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:13.080705 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1d160c35-5ec0-43d0-b7b4-c32af88d2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:13.082066 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1d160c35-5ec0-43d0-b7b4-c32af88d2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.158045 Apr 05 11:17:13.082947 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 249/509] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:12 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:13.318139 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-cf230ae4-1108-4d8a-858f-1665e2571c32 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:13.319076 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-cf230ae4-1108-4d8a-858f-1665e2571c32 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:13.325976 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cf230ae4-1108-4d8a-858f-1665e2571c32 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:13.326466 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cf230ae4-1108-4d8a-858f-1665e2571c32 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:13.327259 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cf230ae4-1108-4d8a-858f-1665e2571c32 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:13.327697 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cf230ae4-1108-4d8a-858f-1665e2571c32 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:13.467460 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cf230ae4-1108-4d8a-858f-1665e2571c32 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:13.474973 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-cf230ae4-1108-4d8a-858f-1665e2571c32 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.161184 Apr 05 11:17:13.475534 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 261/510] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:13 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:13.741585 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f46de6e9-f631-47b3-8239-4a6f026a4add tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:13.742222 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f46de6e9-f631-47b3-8239-4a6f026a4add tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:13.748393 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f46de6e9-f631-47b3-8239-4a6f026a4add tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:13.748843 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f46de6e9-f631-47b3-8239-4a6f026a4add tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:13.749605 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f46de6e9-f631-47b3-8239-4a6f026a4add tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:13.750041 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f46de6e9-f631-47b3-8239-4a6f026a4add tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:13.885284 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f46de6e9-f631-47b3-8239-4a6f026a4add tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:13.893073 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f46de6e9-f631-47b3-8239-4a6f026a4add tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.155447 Apr 05 11:17:13.893635 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 250/511] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:13 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:14.100840 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4a5a789b-e740-4650-b367-928f58ee1dfa tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:14.101501 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4a5a789b-e740-4650-b367-928f58ee1dfa tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:14.107798 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a5a789b-e740-4650-b367-928f58ee1dfa tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:14.108246 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a5a789b-e740-4650-b367-928f58ee1dfa tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:14.109015 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a5a789b-e740-4650-b367-928f58ee1dfa tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:14.109445 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a5a789b-e740-4650-b367-928f58ee1dfa tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:14.246874 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4a5a789b-e740-4650-b367-928f58ee1dfa tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:14.254914 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4a5a789b-e740-4650-b367-928f58ee1dfa tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:14.256487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4a5a789b-e740-4650-b367-928f58ee1dfa tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:14.257630 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4a5a789b-e740-4650-b367-928f58ee1dfa tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.160921 Apr 05 11:17:14.258237 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 262/512] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:14 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:14.492140 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e6040299-33f2-42c2-82bd-2f9d6d3c07b7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:14.492743 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e6040299-33f2-42c2-82bd-2f9d6d3c07b7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:14.500136 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e6040299-33f2-42c2-82bd-2f9d6d3c07b7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:14.500582 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e6040299-33f2-42c2-82bd-2f9d6d3c07b7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:14.501384 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e6040299-33f2-42c2-82bd-2f9d6d3c07b7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:14.501819 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e6040299-33f2-42c2-82bd-2f9d6d3c07b7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:14.635024 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e6040299-33f2-42c2-82bd-2f9d6d3c07b7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:14.642501 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e6040299-33f2-42c2-82bd-2f9d6d3c07b7 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.154221 Apr 05 11:17:14.643107 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 251/513] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:14 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:14.911207 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e405b1d6-e6d0-4d02-aed7-71c2443d2a7e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:14.911734 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e405b1d6-e6d0-4d02-aed7-71c2443d2a7e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:14.918480 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e405b1d6-e6d0-4d02-aed7-71c2443d2a7e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:14.918951 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e405b1d6-e6d0-4d02-aed7-71c2443d2a7e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:14.919712 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e405b1d6-e6d0-4d02-aed7-71c2443d2a7e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:14.920151 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e405b1d6-e6d0-4d02-aed7-71c2443d2a7e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:15.053153 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e405b1d6-e6d0-4d02-aed7-71c2443d2a7e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:15.061423 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e405b1d6-e6d0-4d02-aed7-71c2443d2a7e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.154062 Apr 05 11:17:15.061993 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 263/514] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:14 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:15.277525 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f52693bb-0a0c-41dd-9e47-637984779e56 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:15.278136 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f52693bb-0a0c-41dd-9e47-637984779e56 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:15.284209 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f52693bb-0a0c-41dd-9e47-637984779e56 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:15.284640 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f52693bb-0a0c-41dd-9e47-637984779e56 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:15.285419 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f52693bb-0a0c-41dd-9e47-637984779e56 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:15.285856 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f52693bb-0a0c-41dd-9e47-637984779e56 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:15.417932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f52693bb-0a0c-41dd-9e47-637984779e56 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:15.426696 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f52693bb-0a0c-41dd-9e47-637984779e56 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:15.428301 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f52693bb-0a0c-41dd-9e47-637984779e56 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:15.429642 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f52693bb-0a0c-41dd-9e47-637984779e56 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.156581 Apr 05 11:17:15.430423 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 252/515] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:15 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:15.659840 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d96b45f4-8cd0-4f0b-99dd-13559298963b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:15.660422 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d96b45f4-8cd0-4f0b-99dd-13559298963b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:15.666811 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d96b45f4-8cd0-4f0b-99dd-13559298963b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:15.667266 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d96b45f4-8cd0-4f0b-99dd-13559298963b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:15.668026 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d96b45f4-8cd0-4f0b-99dd-13559298963b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:15.668463 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d96b45f4-8cd0-4f0b-99dd-13559298963b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:15.796577 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d96b45f4-8cd0-4f0b-99dd-13559298963b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:15.803805 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d96b45f4-8cd0-4f0b-99dd-13559298963b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.148101 Apr 05 11:17:15.804374 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 264/516] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:15 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:16.078534 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4c21d70e-a2fe-4453-863c-39c6993b87f9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:16.079079 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4c21d70e-a2fe-4453-863c-39c6993b87f9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:16.085436 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c21d70e-a2fe-4453-863c-39c6993b87f9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:16.085891 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c21d70e-a2fe-4453-863c-39c6993b87f9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:16.086683 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c21d70e-a2fe-4453-863c-39c6993b87f9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:16.087125 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c21d70e-a2fe-4453-863c-39c6993b87f9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:16.224761 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4c21d70e-a2fe-4453-863c-39c6993b87f9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:16.233292 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4c21d70e-a2fe-4453-863c-39c6993b87f9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.158659 Apr 05 11:17:16.233882 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 253/517] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:16 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:16.450335 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d1fb9973-6849-4d7a-8bea-ea1b18c60f8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:16.451012 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d1fb9973-6849-4d7a-8bea-ea1b18c60f8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:16.456759 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d1fb9973-6849-4d7a-8bea-ea1b18c60f8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:16.458931 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d1fb9973-6849-4d7a-8bea-ea1b18c60f8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:16.458931 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d1fb9973-6849-4d7a-8bea-ea1b18c60f8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:16.458931 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d1fb9973-6849-4d7a-8bea-ea1b18c60f8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:16.596301 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d1fb9973-6849-4d7a-8bea-ea1b18c60f8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:16.608904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d1fb9973-6849-4d7a-8bea-ea1b18c60f8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:16.608904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d1fb9973-6849-4d7a-8bea-ea1b18c60f8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:16.608904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d1fb9973-6849-4d7a-8bea-ea1b18c60f8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.162751 Apr 05 11:17:16.609892 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 265/518] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:16 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:16.821055 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9a231221-cc5d-49d8-9a6a-6ddb0231091c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:16.821657 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9a231221-cc5d-49d8-9a6a-6ddb0231091c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:16.827992 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9a231221-cc5d-49d8-9a6a-6ddb0231091c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:16.828432 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9a231221-cc5d-49d8-9a6a-6ddb0231091c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:16.829212 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9a231221-cc5d-49d8-9a6a-6ddb0231091c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:16.829647 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9a231221-cc5d-49d8-9a6a-6ddb0231091c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:16.958820 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9a231221-cc5d-49d8-9a6a-6ddb0231091c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:16.968110 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9a231221-cc5d-49d8-9a6a-6ddb0231091c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.150643 Apr 05 11:17:16.968855 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 254/519] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:16 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:17.250622 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-641db976-1d9f-4ebd-ad50-94d338788019 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:17.251260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-641db976-1d9f-4ebd-ad50-94d338788019 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:17.257477 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-641db976-1d9f-4ebd-ad50-94d338788019 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:17.257936 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-641db976-1d9f-4ebd-ad50-94d338788019 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:17.258744 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-641db976-1d9f-4ebd-ad50-94d338788019 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:17.259185 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-641db976-1d9f-4ebd-ad50-94d338788019 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:17.397695 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-641db976-1d9f-4ebd-ad50-94d338788019 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:17.406076 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-641db976-1d9f-4ebd-ad50-94d338788019 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.159346 Apr 05 11:17:17.406683 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 266/520] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:17 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:17.627609 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ce23ea9d-7041-4250-b340-7cb5811c209d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:17.628278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ce23ea9d-7041-4250-b340-7cb5811c209d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:17.635552 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ce23ea9d-7041-4250-b340-7cb5811c209d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:17.635998 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ce23ea9d-7041-4250-b340-7cb5811c209d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:17.636769 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ce23ea9d-7041-4250-b340-7cb5811c209d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:17.637447 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ce23ea9d-7041-4250-b340-7cb5811c209d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:17.778728 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ce23ea9d-7041-4250-b340-7cb5811c209d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:17.786413 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ce23ea9d-7041-4250-b340-7cb5811c209d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:17.787946 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ce23ea9d-7041-4250-b340-7cb5811c209d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:17.789205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ce23ea9d-7041-4250-b340-7cb5811c209d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.165733 Apr 05 11:17:17.789761 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 255/521] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:17 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:17.985661 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fc1985cf-71cf-4afa-8a53-b61db4d5313e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:17.986197 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fc1985cf-71cf-4afa-8a53-b61db4d5313e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:17.992419 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc1985cf-71cf-4afa-8a53-b61db4d5313e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:17.992907 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc1985cf-71cf-4afa-8a53-b61db4d5313e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:17.993703 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc1985cf-71cf-4afa-8a53-b61db4d5313e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:17.994720 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc1985cf-71cf-4afa-8a53-b61db4d5313e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:18.123414 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fc1985cf-71cf-4afa-8a53-b61db4d5313e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:18.130550 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fc1985cf-71cf-4afa-8a53-b61db4d5313e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.149009 Apr 05 11:17:18.131253 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 267/522] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:17 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:18.423145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-60d3ad31-e28d-431d-a13f-7024e9f93db4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:18.423878 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-60d3ad31-e28d-431d-a13f-7024e9f93db4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:18.429682 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-60d3ad31-e28d-431d-a13f-7024e9f93db4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:18.430129 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-60d3ad31-e28d-431d-a13f-7024e9f93db4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:18.430959 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-60d3ad31-e28d-431d-a13f-7024e9f93db4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:18.431982 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-60d3ad31-e28d-431d-a13f-7024e9f93db4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:18.564708 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-60d3ad31-e28d-431d-a13f-7024e9f93db4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:18.573238 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-60d3ad31-e28d-431d-a13f-7024e9f93db4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1722 microversion: 2.1 time: 0.153995 Apr 05 11:17:18.573809 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 256/523] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:18 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:18.806972 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6557dfad-5064-4b9e-b983-209ebdb27369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:18.807514 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6557dfad-5064-4b9e-b983-209ebdb27369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:18.813701 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6557dfad-5064-4b9e-b983-209ebdb27369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:18.814148 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6557dfad-5064-4b9e-b983-209ebdb27369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:18.814929 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6557dfad-5064-4b9e-b983-209ebdb27369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:18.815368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6557dfad-5064-4b9e-b983-209ebdb27369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:18.947116 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6557dfad-5064-4b9e-b983-209ebdb27369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:18.955365 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6557dfad-5064-4b9e-b983-209ebdb27369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:18.956871 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6557dfad-5064-4b9e-b983-209ebdb27369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:18.958039 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6557dfad-5064-4b9e-b983-209ebdb27369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.155013 Apr 05 11:17:18.958659 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 268/524] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:18 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:19.148192 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3523fd05-43a4-4cd3-937c-3c16ae07b577 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:19.148807 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3523fd05-43a4-4cd3-937c-3c16ae07b577 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:19.155885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3523fd05-43a4-4cd3-937c-3c16ae07b577 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:19.156334 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3523fd05-43a4-4cd3-937c-3c16ae07b577 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:19.157095 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3523fd05-43a4-4cd3-937c-3c16ae07b577 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:19.157683 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3523fd05-43a4-4cd3-937c-3c16ae07b577 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:19.298901 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3523fd05-43a4-4cd3-937c-3c16ae07b577 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:19.306223 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3523fd05-43a4-4cd3-937c-3c16ae07b577 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1508 microversion: 2.1 time: 0.161980 Apr 05 11:17:19.309030 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 257/525] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:19 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:19.590373 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8898624a-af83-4bc6-9e9f-52f8c13b9fe8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:19.591059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8898624a-af83-4bc6-9e9f-52f8c13b9fe8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:19.596967 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8898624a-af83-4bc6-9e9f-52f8c13b9fe8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:19.597415 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8898624a-af83-4bc6-9e9f-52f8c13b9fe8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:19.598174 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8898624a-af83-4bc6-9e9f-52f8c13b9fe8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:19.598616 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8898624a-af83-4bc6-9e9f-52f8c13b9fe8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:19.727054 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8898624a-af83-4bc6-9e9f-52f8c13b9fe8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:19.735654 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8898624a-af83-4bc6-9e9f-52f8c13b9fe8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1699 microversion: 2.1 time: 0.149131 Apr 05 11:17:19.736225 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 269/526] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:19 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1699 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:19.752938 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0426bbd8-718b-41cd-a423-1be17a32cded tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:19.766492 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0426bbd8-718b-41cd-a423-1be17a32cded tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:19.766492 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0426bbd8-718b-41cd-a423-1be17a32cded tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:19.780928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0426bbd8-718b-41cd-a423-1be17a32cded tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Going to try to start instance {{(pid=117594) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 05 11:17:19.977748 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5c00fafc-fdba-464b-8b07-9ca2807ff738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:19.978358 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5c00fafc-fdba-464b-8b07-9ca2807ff738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:19.985196 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c00fafc-fdba-464b-8b07-9ca2807ff738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:19.985649 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c00fafc-fdba-464b-8b07-9ca2807ff738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:19.986586 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c00fafc-fdba-464b-8b07-9ca2807ff738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:19.987062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c00fafc-fdba-464b-8b07-9ca2807ff738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:20.115727 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0426bbd8-718b-41cd-a423-1be17a32cded tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "POST /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/action" status: 202 len: 0 microversion: 2.1 time: 0.366525 Apr 05 11:17:20.120640 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 258/527] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:17:19 2022] POST /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:17:20.126254 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c8adeb15-ee53-4dc6-9bc4-d228606e2ada tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:20.127186 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c8adeb15-ee53-4dc6-9bc4-d228606e2ada tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:20.127497 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5c00fafc-fdba-464b-8b07-9ca2807ff738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:20.134520 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c8adeb15-ee53-4dc6-9bc4-d228606e2ada tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:20.134967 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c8adeb15-ee53-4dc6-9bc4-d228606e2ada tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:20.136021 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c8adeb15-ee53-4dc6-9bc4-d228606e2ada tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:20.136445 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c8adeb15-ee53-4dc6-9bc4-d228606e2ada tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:20.136677 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5c00fafc-fdba-464b-8b07-9ca2807ff738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:20.138297 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5c00fafc-fdba-464b-8b07-9ca2807ff738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:20.139671 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5c00fafc-fdba-464b-8b07-9ca2807ff738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.165916 Apr 05 11:17:20.140688 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 270/528] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:19 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:17:20.275235 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c8adeb15-ee53-4dc6-9bc4-d228606e2ada tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:20.283789 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c8adeb15-ee53-4dc6-9bc4-d228606e2ada tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1708 microversion: 2.1 time: 0.161466 Apr 05 11:17:20.284365 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 259/529] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:20 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1708 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:20.323779 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ead12222-bcca-4b46-9f69-bf52dc01b293 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:20.324391 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ead12222-bcca-4b46-9f69-bf52dc01b293 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:20.330363 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ead12222-bcca-4b46-9f69-bf52dc01b293 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:20.330856 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ead12222-bcca-4b46-9f69-bf52dc01b293 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:20.331634 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ead12222-bcca-4b46-9f69-bf52dc01b293 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:20.332069 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ead12222-bcca-4b46-9f69-bf52dc01b293 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:20.469984 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ead12222-bcca-4b46-9f69-bf52dc01b293 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:20.477566 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ead12222-bcca-4b46-9f69-bf52dc01b293 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1514 microversion: 2.1 time: 0.157522 Apr 05 11:17:20.478064 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 271/530] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:20 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:21.161862 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2cfffe70-e495-4e92-955b-e85de9b0f639 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:21.162960 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2cfffe70-e495-4e92-955b-e85de9b0f639 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:21.173247 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2cfffe70-e495-4e92-955b-e85de9b0f639 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:21.173882 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2cfffe70-e495-4e92-955b-e85de9b0f639 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:21.174711 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2cfffe70-e495-4e92-955b-e85de9b0f639 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:21.175159 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2cfffe70-e495-4e92-955b-e85de9b0f639 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:21.301904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-67295053-2313-454e-b7be-e92f23dd12e8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:21.302527 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-67295053-2313-454e-b7be-e92f23dd12e8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:21.310267 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-67295053-2313-454e-b7be-e92f23dd12e8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:21.311063 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-67295053-2313-454e-b7be-e92f23dd12e8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:21.312030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-67295053-2313-454e-b7be-e92f23dd12e8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:21.312620 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-67295053-2313-454e-b7be-e92f23dd12e8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:21.360567 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2cfffe70-e495-4e92-955b-e85de9b0f639 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:21.374189 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2cfffe70-e495-4e92-955b-e85de9b0f639 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:21.377065 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2cfffe70-e495-4e92-955b-e85de9b0f639 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:21.378458 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2cfffe70-e495-4e92-955b-e85de9b0f639 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.223747 Apr 05 11:17:21.379806 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 260/531] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:21 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:17:21.696684 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-67295053-2313-454e-b7be-e92f23dd12e8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:21.704582 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-67295053-2313-454e-b7be-e92f23dd12e8 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1708 microversion: 2.1 time: 0.407171 Apr 05 11:17:21.705171 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 272/532] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:21 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1708 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:21.951444 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6cc8d749-da4e-4c42-953d-fa9b0035f761 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Action: 'create', calling method: .version_select at 0x7fec0c0aa670>, body: {"keypair": {"name": "tempest-keypair-1682094841"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:22.005649 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-6cc8d749-da4e-4c42-953d-fa9b0035f761 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:17:22.015711 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-6cc8d749-da4e-4c42-953d-fa9b0035f761 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for user 08f7e9cf075d43b39802bbdc58cd604f and project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:17:22.350978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-6cc8d749-da4e-4c42-953d-fa9b0035f761 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:17:22.355610 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-6cc8d749-da4e-4c42-953d-fa9b0035f761 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for user 08f7e9cf075d43b39802bbdc58cd604f and project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:17:22.369854 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6cc8d749-da4e-4c42-953d-fa9b0035f761 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.422741 Apr 05 11:17:22.371736 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 261/533] 10.222.0.39 () {60 vars in 1157 bytes} [Tue Apr 5 11:17:21 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:22.397276 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-db8aa309-e286-4169-bd35-e4b4deab295f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:22.399004 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-db8aa309-e286-4169-bd35-e4b4deab295f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:22.410701 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db8aa309-e286-4169-bd35-e4b4deab295f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:22.416644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db8aa309-e286-4169-bd35-e4b4deab295f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:22.416644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db8aa309-e286-4169-bd35-e4b4deab295f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:22.416644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db8aa309-e286-4169-bd35-e4b4deab295f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:22.628016 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db8aa309-e286-4169-bd35-e4b4deab295f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:22.645419 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db8aa309-e286-4169-bd35-e4b4deab295f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:22.647260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db8aa309-e286-4169-bd35-e4b4deab295f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:22.648484 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-db8aa309-e286-4169-bd35-e4b4deab295f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.255131 Apr 05 11:17:22.649251 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 273/534] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:22 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:22.724068 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d4e4d5c3-f3ea-43df-a384-9c7f3ccb0829 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:22.724933 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d4e4d5c3-f3ea-43df-a384-9c7f3ccb0829 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:22.734872 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d4e4d5c3-f3ea-43df-a384-9c7f3ccb0829 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:22.735474 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d4e4d5c3-f3ea-43df-a384-9c7f3ccb0829 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:22.738048 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d4e4d5c3-f3ea-43df-a384-9c7f3ccb0829 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:22.738928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d4e4d5c3-f3ea-43df-a384-9c7f3ccb0829 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:22.910750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d4e4d5c3-f3ea-43df-a384-9c7f3ccb0829 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:22.919712 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d4e4d5c3-f3ea-43df-a384-9c7f3ccb0829 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1708 microversion: 2.1 time: 0.202128 Apr 05 11:17:22.920486 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 262/535] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:22 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1708 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:23.083396 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6fa5c1b9-233b-4384-81d1-58f0c12ab515 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:23.083893 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6fa5c1b9-233b-4384-81d1-58f0c12ab515 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:23.092301 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6fa5c1b9-233b-4384-81d1-58f0c12ab515 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:23.095449 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6fa5c1b9-233b-4384-81d1-58f0c12ab515 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:23.095449 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6fa5c1b9-233b-4384-81d1-58f0c12ab515 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:23.095449 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6fa5c1b9-233b-4384-81d1-58f0c12ab515 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:23.268960 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-6fa5c1b9-233b-4384-81d1-58f0c12ab515 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lazy-loading 'services' on Instance uuid 33780d13-dfbe-43c6-aefe-247d419ec74d {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:17:23.355073 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5c0adc92-b83e-4b8a-9505-4e665d63f588 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Action: 'create', calling method: .version_select at 0x7fec0c185d30>, body: {"keypair": {"name": "tempest-keypair-807568226"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:23.375236 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-5c0adc92-b83e-4b8a-9505-4e665d63f588 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Getting quotas for project cf751cbfd21e463e83beea4d29713404. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:17:23.380859 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-5c0adc92-b83e-4b8a-9505-4e665d63f588 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Getting quotas for user 2c4fa0f1800044a5bb00641ed885841f and project cf751cbfd21e463e83beea4d29713404. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:17:23.596438 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6fa5c1b9-233b-4384-81d1-58f0c12ab515 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "DELETE /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d/os-volume_attachments/ad07ec48-73c5-45fa-8f31-c5a49a98305d" status: 202 len: 0 microversion: 2.1 time: 0.512281 Apr 05 11:17:23.596438 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 274/536] 10.222.0.39 () {58 vars in 1415 bytes} [Tue Apr 5 11:17:23 2022] DELETE /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d/os-volume_attachments/ad07ec48-73c5-45fa-8f31-c5a49a98305d => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:17:23.668793 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-384182eb-704a-44bc-92f8-a0957cff5970 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:23.669707 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-384182eb-704a-44bc-92f8-a0957cff5970 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:23.677626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-384182eb-704a-44bc-92f8-a0957cff5970 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:23.678522 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-384182eb-704a-44bc-92f8-a0957cff5970 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:23.679714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-384182eb-704a-44bc-92f8-a0957cff5970 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:23.680302 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-384182eb-704a-44bc-92f8-a0957cff5970 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:23.868897 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-5c0adc92-b83e-4b8a-9505-4e665d63f588 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Getting quotas for project cf751cbfd21e463e83beea4d29713404. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:17:23.874023 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-5c0adc92-b83e-4b8a-9505-4e665d63f588 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Getting quotas for user 2c4fa0f1800044a5bb00641ed885841f and project cf751cbfd21e463e83beea4d29713404. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:17:23.881384 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-384182eb-704a-44bc-92f8-a0957cff5970 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:23.894711 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-384182eb-704a-44bc-92f8-a0957cff5970 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:23.903636 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-384182eb-704a-44bc-92f8-a0957cff5970 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:23.904899 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-384182eb-704a-44bc-92f8-a0957cff5970 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.241360 Apr 05 11:17:23.915733 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 275/537] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:23 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:23.916413 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5c0adc92-b83e-4b8a-9505-4e665d63f588 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.555322 Apr 05 11:17:23.916413 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 263/538] 10.222.0.39 () {60 vars in 1157 bytes} [Tue Apr 5 11:17:23 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:23.936929 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4f6c8623-5ea4-4fa5-95ee-a7b01226729a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:23.937549 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4f6c8623-5ea4-4fa5-95ee-a7b01226729a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:23.943869 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f6c8623-5ea4-4fa5-95ee-a7b01226729a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:23.944464 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f6c8623-5ea4-4fa5-95ee-a7b01226729a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:23.945272 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f6c8623-5ea4-4fa5-95ee-a7b01226729a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:23.945776 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f6c8623-5ea4-4fa5-95ee-a7b01226729a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:24.219811 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4f6c8623-5ea4-4fa5-95ee-a7b01226729a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:24.228499 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4f6c8623-5ea4-4fa5-95ee-a7b01226729a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1708 microversion: 2.1 time: 0.295143 Apr 05 11:17:24.238742 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 276/539] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:23 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1708 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:24.924194 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3ded977c-0124-4ddf-a46f-f6848f13f4e6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:24.924735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3ded977c-0124-4ddf-a46f-f6848f13f4e6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:24.933773 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3ded977c-0124-4ddf-a46f-f6848f13f4e6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:24.934653 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3ded977c-0124-4ddf-a46f-f6848f13f4e6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:24.937202 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3ded977c-0124-4ddf-a46f-f6848f13f4e6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:24.937925 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3ded977c-0124-4ddf-a46f-f6848f13f4e6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:25.086131 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3ded977c-0124-4ddf-a46f-f6848f13f4e6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:25.095062 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3ded977c-0124-4ddf-a46f-f6848f13f4e6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:25.096664 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3ded977c-0124-4ddf-a46f-f6848f13f4e6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:25.097873 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3ded977c-0124-4ddf-a46f-f6848f13f4e6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.178187 Apr 05 11:17:25.098657 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 264/540] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:24 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:25.246092 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-edce0dac-7c02-46b7-92f7-a0baee96eea7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:25.247346 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-edce0dac-7c02-46b7-92f7-a0baee96eea7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:25.271917 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-edce0dac-7c02-46b7-92f7-a0baee96eea7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:25.272721 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-edce0dac-7c02-46b7-92f7-a0baee96eea7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:25.273698 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-edce0dac-7c02-46b7-92f7-a0baee96eea7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:25.274323 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-edce0dac-7c02-46b7-92f7-a0baee96eea7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:25.515163 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-edce0dac-7c02-46b7-92f7-a0baee96eea7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:25.523624 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-edce0dac-7c02-46b7-92f7-a0baee96eea7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1712 microversion: 2.1 time: 0.281667 Apr 05 11:17:25.524224 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 277/541] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:25 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1712 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:25.962396 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-361369781", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61947bc0-bf95-4d84-a95a-a866833cbe78"}], "security_groups": [{"name": "tempest-securitygroup--136322821"}], "key_name": "tempest-keypair-1682094841", "user_data": "}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:26.112662 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] validate_networks() for [('61947bc0-bf95-4d84-a95a-a866833cbe78', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:17:26.117079 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5a6308c6-610b-4a74-966e-1d84f0718cad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:26.118253 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5a6308c6-610b-4a74-966e-1d84f0718cad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:26.125723 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5a6308c6-610b-4a74-966e-1d84f0718cad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:26.126826 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5a6308c6-610b-4a74-966e-1d84f0718cad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:26.131171 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5a6308c6-610b-4a74-966e-1d84f0718cad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:26.131171 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5a6308c6-610b-4a74-966e-1d84f0718cad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:26.324349 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5a6308c6-610b-4a74-966e-1d84f0718cad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:26.334015 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5a6308c6-610b-4a74-966e-1d84f0718cad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:26.335548 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5a6308c6-610b-4a74-966e-1d84f0718cad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:26.336937 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5a6308c6-610b-4a74-966e-1d84f0718cad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.223876 Apr 05 11:17:26.337948 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 278/542] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:26 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:17:26.734919 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:17:26.735331 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:17:26.735928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:17:26.736347 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:17:26.736753 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:17:26.746238 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:26.746715 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:26.747767 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:26.748108 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:26.768451 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:17:26.772321 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for user 08f7e9cf075d43b39802bbdc58cd604f and project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:17:26.783719 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:17:26.785989 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:17:26.945010 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-88e589e4-7343-437d-aa48-9e9772b8e148 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:26.946295 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-88e589e4-7343-437d-aa48-9e9772b8e148 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:26.960162 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-88e589e4-7343-437d-aa48-9e9772b8e148 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:26.961035 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-88e589e4-7343-437d-aa48-9e9772b8e148 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:26.962093 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-88e589e4-7343-437d-aa48-9e9772b8e148 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:26.964151 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-88e589e4-7343-437d-aa48-9e9772b8e148 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:26.978158 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c5a932bc-677d-408c-b815-58bd651981dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.019855 Apr 05 11:17:26.984266 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 265/543] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:17:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 11:17:26.989468 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-988c7a57-07a1-4bbc-87f9-38662d1deaab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:26.998399 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-988c7a57-07a1-4bbc-87f9-38662d1deaab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:26.998590 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-88e589e4-7343-437d-aa48-9e9772b8e148 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:17:27.057417 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-988c7a57-07a1-4bbc-87f9-38662d1deaab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:27.070507 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-988c7a57-07a1-4bbc-87f9-38662d1deaab tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1241 microversion: 2.1 time: 0.084828 Apr 05 11:17:27.071258 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 266/544] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:26 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:27.348939 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-88e589e4-7343-437d-aa48-9e9772b8e148 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "DELETE /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 204 len: 0 microversion: 2.1 time: 0.407649 Apr 05 11:17:27.353606 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 279/545] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:17:26 2022] DELETE /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:17:27.365778 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fd9e6e00-b010-4e35-959d-f003e96109fb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:27.367206 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fd9e6e00-b010-4e35-959d-f003e96109fb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:27.373923 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6bc1dd28-96ee-4203-bb2e-a2aa2f4ce750 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:27.379291 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6bc1dd28-96ee-4203-bb2e-a2aa2f4ce750 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:27.384614 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fd9e6e00-b010-4e35-959d-f003e96109fb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:27.390378 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6bc1dd28-96ee-4203-bb2e-a2aa2f4ce750 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:27.390378 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6bc1dd28-96ee-4203-bb2e-a2aa2f4ce750 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:27.390378 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6bc1dd28-96ee-4203-bb2e-a2aa2f4ce750 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:27.390378 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6bc1dd28-96ee-4203-bb2e-a2aa2f4ce750 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:27.393004 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fd9e6e00-b010-4e35-959d-f003e96109fb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:27.394079 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fd9e6e00-b010-4e35-959d-f003e96109fb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:27.394520 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fd9e6e00-b010-4e35-959d-f003e96109fb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:27.548117 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6bc1dd28-96ee-4203-bb2e-a2aa2f4ce750 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:27.558124 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6bc1dd28-96ee-4203-bb2e-a2aa2f4ce750 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1511 microversion: 2.1 time: 0.196812 Apr 05 11:17:27.559089 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 280/546] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:27 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1511 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:27.659475 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fd9e6e00-b010-4e35-959d-f003e96109fb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:27.671787 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fd9e6e00-b010-4e35-959d-f003e96109fb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:27.673316 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fd9e6e00-b010-4e35-959d-f003e96109fb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:27.674485 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fd9e6e00-b010-4e35-959d-f003e96109fb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.319319 Apr 05 11:17:27.675076 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 267/547] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:27 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:27.989870 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-689940637", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a84177b0-98a3-43e8-9748-217cec2ce77a"}], "security_groups": [{"name": "tempest-securitygroup--1573023024"}], "key_name": "tempest-keypair-807568226", "user_data": "}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:28.090053 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-70279586-1e00-4504-95af-d89d3ccbc312 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:28.091378 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-70279586-1e00-4504-95af-d89d3ccbc312 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:28.109823 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] validate_networks() for [('a84177b0-98a3-43e8-9748-217cec2ce77a', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:17:28.155307 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-70279586-1e00-4504-95af-d89d3ccbc312 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:28.165028 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-70279586-1e00-4504-95af-d89d3ccbc312 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1241 microversion: 2.1 time: 0.080930 Apr 05 11:17:28.166314 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 268/548] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:28 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:28.551912 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:17:28.552460 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:17:28.552940 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:17:28.553348 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:17:28.553851 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:17:28.562709 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:28.563138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:28.563935 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:28.564368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:28.576083 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-57dc8826-c56f-45fe-a922-5801388e0656 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:28.576698 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-57dc8826-c56f-45fe-a922-5801388e0656 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:28.582527 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Getting quotas for project cf751cbfd21e463e83beea4d29713404. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:17:28.582968 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-57dc8826-c56f-45fe-a922-5801388e0656 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:28.583630 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-57dc8826-c56f-45fe-a922-5801388e0656 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:28.584788 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-57dc8826-c56f-45fe-a922-5801388e0656 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:28.585453 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-57dc8826-c56f-45fe-a922-5801388e0656 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:28.592181 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Getting quotas for user 2c4fa0f1800044a5bb00641ed885841f and project cf751cbfd21e463e83beea4d29713404. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:17:28.605498 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:17:28.607808 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:17:28.733026 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-57dc8826-c56f-45fe-a922-5801388e0656 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:28.742640 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-57dc8826-c56f-45fe-a922-5801388e0656 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1511 microversion: 2.1 time: 0.169941 Apr 05 11:17:28.752994 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 269/549] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:28 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:28.752994 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a04a9abe-28cd-41dd-8108-781f9ceee1e5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:28.753209 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a04a9abe-28cd-41dd-8108-781f9ceee1e5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:28.760627 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a04a9abe-28cd-41dd-8108-781f9ceee1e5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:28.761098 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a04a9abe-28cd-41dd-8108-781f9ceee1e5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:28.761872 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a04a9abe-28cd-41dd-8108-781f9ceee1e5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:28.762309 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a04a9abe-28cd-41dd-8108-781f9ceee1e5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:28.775920 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7eaa56cc-0a1b-4c5b-843b-180b9b0dc186 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.791238 Apr 05 11:17:28.779881 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 281/550] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:17:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:17:28.786816 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2053a3ca-ef54-4cd5-93f6-b5f3a6e57708 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:28.787435 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2053a3ca-ef54-4cd5-93f6-b5f3a6e57708 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:28.851545 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2053a3ca-ef54-4cd5-93f6-b5f3a6e57708 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:28.859000 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2053a3ca-ef54-4cd5-93f6-b5f3a6e57708 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1244 microversion: 2.1 time: 0.076046 Apr 05 11:17:28.870537 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 282/551] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:28 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:28.953830 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a04a9abe-28cd-41dd-8108-781f9ceee1e5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:28.963012 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a04a9abe-28cd-41dd-8108-781f9ceee1e5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:28.964716 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a04a9abe-28cd-41dd-8108-781f9ceee1e5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:28.965849 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a04a9abe-28cd-41dd-8108-781f9ceee1e5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.217491 Apr 05 11:17:28.977932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 270/552] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:28 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:29.183338 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d3cd641c-5b40-4fa6-8879-756f0e41fed0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:29.184016 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d3cd641c-5b40-4fa6-8879-756f0e41fed0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:29.192714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3cd641c-5b40-4fa6-8879-756f0e41fed0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:29.193182 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3cd641c-5b40-4fa6-8879-756f0e41fed0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:29.194022 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3cd641c-5b40-4fa6-8879-756f0e41fed0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:29.194463 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3cd641c-5b40-4fa6-8879-756f0e41fed0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:29.254996 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d3cd641c-5b40-4fa6-8879-756f0e41fed0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:29.263021 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d3cd641c-5b40-4fa6-8879-756f0e41fed0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1245 microversion: 2.1 time: 0.084409 Apr 05 11:17:29.263613 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 283/553] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:29 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:29.760838 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-286e3382-7276-41c8-bfac-69994760c701 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:29.761384 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-286e3382-7276-41c8-bfac-69994760c701 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:29.767990 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-286e3382-7276-41c8-bfac-69994760c701 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:29.768441 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-286e3382-7276-41c8-bfac-69994760c701 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:29.769214 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-286e3382-7276-41c8-bfac-69994760c701 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:29.769646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-286e3382-7276-41c8-bfac-69994760c701 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:29.876202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4e0f952f-963b-42db-b062-a9718b086822 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:29.876893 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4e0f952f-963b-42db-b062-a9718b086822 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:29.882908 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4e0f952f-963b-42db-b062-a9718b086822 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:29.883356 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4e0f952f-963b-42db-b062-a9718b086822 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:29.884122 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4e0f952f-963b-42db-b062-a9718b086822 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:29.884564 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4e0f952f-963b-42db-b062-a9718b086822 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:29.913325 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-286e3382-7276-41c8-bfac-69994760c701 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:29.920989 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-286e3382-7276-41c8-bfac-69994760c701 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1511 microversion: 2.1 time: 0.164173 Apr 05 11:17:29.921567 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 271/554] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:29 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:29.947955 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4e0f952f-963b-42db-b062-a9718b086822 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:29.957706 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4e0f952f-963b-42db-b062-a9718b086822 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1248 microversion: 2.1 time: 0.085331 Apr 05 11:17:29.962775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 284/555] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:29 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:29.985127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e113d3e9-e11d-4d0b-8318-cb70a1400ced tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:29.985737 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e113d3e9-e11d-4d0b-8318-cb70a1400ced tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:29.991664 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e113d3e9-e11d-4d0b-8318-cb70a1400ced tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:29.995677 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e113d3e9-e11d-4d0b-8318-cb70a1400ced tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:29.995677 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e113d3e9-e11d-4d0b-8318-cb70a1400ced tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:29.995677 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e113d3e9-e11d-4d0b-8318-cb70a1400ced tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:30.148152 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e113d3e9-e11d-4d0b-8318-cb70a1400ced tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:30.156222 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e113d3e9-e11d-4d0b-8318-cb70a1400ced tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:30.157800 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e113d3e9-e11d-4d0b-8318-cb70a1400ced tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:30.158973 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e113d3e9-e11d-4d0b-8318-cb70a1400ced tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.177725 Apr 05 11:17:30.159538 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 272/556] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:29 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:30.280536 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-93f6b502-0951-44ea-bcf1-1a8e670d1810 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:30.281160 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-93f6b502-0951-44ea-bcf1-1a8e670d1810 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:30.289263 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93f6b502-0951-44ea-bcf1-1a8e670d1810 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:30.290513 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93f6b502-0951-44ea-bcf1-1a8e670d1810 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:30.292062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93f6b502-0951-44ea-bcf1-1a8e670d1810 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:30.292568 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93f6b502-0951-44ea-bcf1-1a8e670d1810 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:30.375486 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-93f6b502-0951-44ea-bcf1-1a8e670d1810 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:30.383875 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-93f6b502-0951-44ea-bcf1-1a8e670d1810 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1293 microversion: 2.1 time: 0.108239 Apr 05 11:17:30.384466 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 285/557] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:30 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:30.952143 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-55647838-c568-49d2-9c05-b62d20de6c68 req-f0d9b5c0-5a9d-4c80-8a27-5eaa6e985bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33780d13-dfbe-43c6-aefe-247d419ec74d", "name": "network-vif-deleted", "tag": "08ffd9a9-b769-4ccb-937e-63b57c1a883a"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:30.954765 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8084aa80-7a30-49be-857a-9462ad342bd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:30.961564 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8084aa80-7a30-49be-857a-9462ad342bd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:30.984495 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8084aa80-7a30-49be-857a-9462ad342bd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:30.987252 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8084aa80-7a30-49be-857a-9462ad342bd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:30.990037 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8084aa80-7a30-49be-857a-9462ad342bd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:30.992589 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8084aa80-7a30-49be-857a-9462ad342bd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:30.996518 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-55647838-c568-49d2-9c05-b62d20de6c68 req-f0d9b5c0-5a9d-4c80-8a27-5eaa6e985bf4 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:31.001377 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-55647838-c568-49d2-9c05-b62d20de6c68 req-f0d9b5c0-5a9d-4c80-8a27-5eaa6e985bf4 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:31.036691 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-55647838-c568-49d2-9c05-b62d20de6c68 req-f0d9b5c0-5a9d-4c80-8a27-5eaa6e985bf4 service nova] Creating event network-vif-deleted:08ffd9a9-b769-4ccb-937e-63b57c1a883a for instance 33780d13-dfbe-43c6-aefe-247d419ec74d on hv-cinder-81899 Apr 05 11:17:31.049798 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-55647838-c568-49d2-9c05-b62d20de6c68 req-f0d9b5c0-5a9d-4c80-8a27-5eaa6e985bf4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103702 Apr 05 11:17:31.053728 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 286/558] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:17:31.068962 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8b6121f5-6505-42cd-a029-06345f3f7453 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:31.072035 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8b6121f5-6505-42cd-a029-06345f3f7453 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:31.101961 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8b6121f5-6505-42cd-a029-06345f3f7453 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:31.103317 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8b6121f5-6505-42cd-a029-06345f3f7453 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:31.105035 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8b6121f5-6505-42cd-a029-06345f3f7453 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:31.105719 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8b6121f5-6505-42cd-a029-06345f3f7453 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:31.205175 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8b6121f5-6505-42cd-a029-06345f3f7453 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:31.214414 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8b6121f5-6505-42cd-a029-06345f3f7453 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1240 microversion: 2.1 time: 0.155926 Apr 05 11:17:31.225361 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8084aa80-7a30-49be-857a-9462ad342bd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:31.225948 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 287/559] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:31 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1240 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:31.233188 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e635d3aa-2cc5-435b-bc55-561b787c04a8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:31.234082 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e635d3aa-2cc5-435b-bc55-561b787c04a8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:31.235620 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8084aa80-7a30-49be-857a-9462ad342bd3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1469 microversion: 2.1 time: 0.299042 Apr 05 11:17:31.237137 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 273/560] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:30 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1469 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:31.244183 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e635d3aa-2cc5-435b-bc55-561b787c04a8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:31.245489 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e635d3aa-2cc5-435b-bc55-561b787c04a8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:31.246817 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e635d3aa-2cc5-435b-bc55-561b787c04a8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:31.247527 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e635d3aa-2cc5-435b-bc55-561b787c04a8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:31.391041 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e635d3aa-2cc5-435b-bc55-561b787c04a8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:31.400999 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-adaa7d90-148c-4775-abd8-9f8f30b644ec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:31.401696 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-adaa7d90-148c-4775-abd8-9f8f30b644ec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:31.406375 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e635d3aa-2cc5-435b-bc55-561b787c04a8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:31.407910 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e635d3aa-2cc5-435b-bc55-561b787c04a8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:31.409217 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e635d3aa-2cc5-435b-bc55-561b787c04a8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.181699 Apr 05 11:17:31.409743 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-adaa7d90-148c-4775-abd8-9f8f30b644ec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:31.410312 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-adaa7d90-148c-4775-abd8-9f8f30b644ec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:31.411188 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-adaa7d90-148c-4775-abd8-9f8f30b644ec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:31.411712 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-adaa7d90-148c-4775-abd8-9f8f30b644ec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:31.423609 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 288/561] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:31 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:31.506217 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-adaa7d90-148c-4775-abd8-9f8f30b644ec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:31.515296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-adaa7d90-148c-4775-abd8-9f8f30b644ec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1299 microversion: 2.1 time: 0.118160 Apr 05 11:17:31.515871 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 274/562] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:31 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:32.232756 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef5cd5e8-12d4-4cac-b555-fda44c3a9d6a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:32.234420 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ef5cd5e8-12d4-4cac-b555-fda44c3a9d6a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:32.241195 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef5cd5e8-12d4-4cac-b555-fda44c3a9d6a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:32.252626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef5cd5e8-12d4-4cac-b555-fda44c3a9d6a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:32.252626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef5cd5e8-12d4-4cac-b555-fda44c3a9d6a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:32.252626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef5cd5e8-12d4-4cac-b555-fda44c3a9d6a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:32.254203 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2bcaeedb-362f-438d-8a67-dba2c795918b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:32.255335 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2bcaeedb-362f-438d-8a67-dba2c795918b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:32.265109 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bcaeedb-362f-438d-8a67-dba2c795918b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:32.265823 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bcaeedb-362f-438d-8a67-dba2c795918b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:32.266638 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bcaeedb-362f-438d-8a67-dba2c795918b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:32.267258 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bcaeedb-362f-438d-8a67-dba2c795918b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:32.346383 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef5cd5e8-12d4-4cac-b555-fda44c3a9d6a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:32.350056 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bcaeedb-362f-438d-8a67-dba2c795918b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:32.354667 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ef5cd5e8-12d4-4cac-b555-fda44c3a9d6a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1296 microversion: 2.1 time: 0.125668 Apr 05 11:17:32.355414 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bcaeedb-362f-438d-8a67-dba2c795918b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:32.355956 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-2bcaeedb-362f-438d-8a67-dba2c795918b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lazy-loading 'fault' on Instance uuid 33780d13-dfbe-43c6-aefe-247d419ec74d {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:17:32.366768 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 289/563] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:32 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1296 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:32.415359 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2bcaeedb-362f-438d-8a67-dba2c795918b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:32.425435 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2bcaeedb-362f-438d-8a67-dba2c795918b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 200 len: 1307 microversion: 2.1 time: 0.175545 Apr 05 11:17:32.426252 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 275/564] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:32 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 1307 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:32.430439 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d0bb775d-3560-4087-a953-eb555f7bd390 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:32.431151 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d0bb775d-3560-4087-a953-eb555f7bd390 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:32.446954 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0bb775d-3560-4087-a953-eb555f7bd390 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:32.448005 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0bb775d-3560-4087-a953-eb555f7bd390 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:32.448826 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0bb775d-3560-4087-a953-eb555f7bd390 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:32.449304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0bb775d-3560-4087-a953-eb555f7bd390 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:32.533212 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3c77fff4-101f-4bf3-b68f-afbd784396a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:32.533874 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3c77fff4-101f-4bf3-b68f-afbd784396a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:32.545025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3c77fff4-101f-4bf3-b68f-afbd784396a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:32.545948 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3c77fff4-101f-4bf3-b68f-afbd784396a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:32.547165 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3c77fff4-101f-4bf3-b68f-afbd784396a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:32.547729 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3c77fff4-101f-4bf3-b68f-afbd784396a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:32.722300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d0bb775d-3560-4087-a953-eb555f7bd390 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:32.731268 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d0bb775d-3560-4087-a953-eb555f7bd390 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:32.732822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d0bb775d-3560-4087-a953-eb555f7bd390 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:32.746032 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d0bb775d-3560-4087-a953-eb555f7bd390 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.319219 Apr 05 11:17:32.746990 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 290/565] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:32 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:17:32.845444 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3c77fff4-101f-4bf3-b68f-afbd784396a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:32.855578 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3c77fff4-101f-4bf3-b68f-afbd784396a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.326617 Apr 05 11:17:32.857795 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 276/566] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:32 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:33.376900 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a14eb98c-bab8-4b65-b210-a701d00c6f73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:33.377575 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a14eb98c-bab8-4b65-b210-a701d00c6f73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:33.386049 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a14eb98c-bab8-4b65-b210-a701d00c6f73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:33.386505 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a14eb98c-bab8-4b65-b210-a701d00c6f73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:33.387518 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a14eb98c-bab8-4b65-b210-a701d00c6f73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:33.388119 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a14eb98c-bab8-4b65-b210-a701d00c6f73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:33.443815 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5226dfdc-5cf7-492f-a6ab-373e774b9e60 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:33.444675 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5226dfdc-5cf7-492f-a6ab-373e774b9e60 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: 33780d13-dfbe-43c6-aefe-247d419ec74d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:33.459855 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5226dfdc-5cf7-492f-a6ab-373e774b9e60 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:33.461887 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5226dfdc-5cf7-492f-a6ab-373e774b9e60 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:33.464181 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5226dfdc-5cf7-492f-a6ab-373e774b9e60 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:33.464750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5226dfdc-5cf7-492f-a6ab-373e774b9e60 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:33.527173 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-5226dfdc-5cf7-492f-a6ab-373e774b9e60 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] HTTP exception thrown: Instance 33780d13-dfbe-43c6-aefe-247d419ec74d could not be found. Apr 05 11:17:33.528578 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5226dfdc-5cf7-492f-a6ab-373e774b9e60 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Returning 404 to user: Instance 33780d13-dfbe-43c6-aefe-247d419ec74d could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:17:33.531078 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5226dfdc-5cf7-492f-a6ab-373e774b9e60 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d" status: 404 len: 111 microversion: 2.1 time: 0.091873 Apr 05 11:17:33.567035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 277/567] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:33 2022] GET /compute/v2.1/servers/33780d13-dfbe-43c6-aefe-247d419ec74d => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:17:33.768835 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ceb6af28-70d0-42ed-b410-3f02e2267ef5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:33.769646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ceb6af28-70d0-42ed-b410-3f02e2267ef5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:33.780242 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ceb6af28-70d0-42ed-b410-3f02e2267ef5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:33.780702 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ceb6af28-70d0-42ed-b410-3f02e2267ef5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:33.782023 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ceb6af28-70d0-42ed-b410-3f02e2267ef5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:33.782413 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ceb6af28-70d0-42ed-b410-3f02e2267ef5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:34.015485 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ceb6af28-70d0-42ed-b410-3f02e2267ef5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:34.015485 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ceb6af28-70d0-42ed-b410-3f02e2267ef5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:34.016304 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ceb6af28-70d0-42ed-b410-3f02e2267ef5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:34.017520 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ceb6af28-70d0-42ed-b410-3f02e2267ef5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.254503 Apr 05 11:17:34.018086 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 278/568] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:33 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:17:34.022706 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d85cbe8e-1b5e-4c34-861f-feefdfec42e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:34.023313 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d85cbe8e-1b5e-4c34-861f-feefdfec42e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:34.023645 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a14eb98c-bab8-4b65-b210-a701d00c6f73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:34.030046 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d85cbe8e-1b5e-4c34-861f-feefdfec42e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:34.030497 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d85cbe8e-1b5e-4c34-861f-feefdfec42e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:34.031333 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d85cbe8e-1b5e-4c34-861f-feefdfec42e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:34.031765 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d85cbe8e-1b5e-4c34-861f-feefdfec42e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:34.033506 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a14eb98c-bab8-4b65-b210-a701d00c6f73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.660536 Apr 05 11:17:34.034241 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 291/569] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:33 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:34.171606 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d85cbe8e-1b5e-4c34-861f-feefdfec42e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:34.179047 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d85cbe8e-1b5e-4c34-861f-feefdfec42e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.159944 Apr 05 11:17:34.179635 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 279/570] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:34 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:34.317350 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-26f9645c-5557-42c9-9ef4-260a6b62ac03 req-fb8dfd8f-e4e8-48a0-9d2e-b81f9c6690c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83911c9a-66fa-4dc2-b353-e8367ed89f27", "tag": "41e4db55-0008-44c7-9892-ce0d8234ca56"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:34.327763 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-26f9645c-5557-42c9-9ef4-260a6b62ac03 req-fb8dfd8f-e4e8-48a0-9d2e-b81f9c6690c4 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:34.328434 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-26f9645c-5557-42c9-9ef4-260a6b62ac03 req-fb8dfd8f-e4e8-48a0-9d2e-b81f9c6690c4 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:34.364663 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-26f9645c-5557-42c9-9ef4-260a6b62ac03 req-fb8dfd8f-e4e8-48a0-9d2e-b81f9c6690c4 service nova] Creating event network-changed:41e4db55-0008-44c7-9892-ce0d8234ca56 for instance 83911c9a-66fa-4dc2-b353-e8367ed89f27 on hv-cinder-81899 Apr 05 11:17:34.376781 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-26f9645c-5557-42c9-9ef4-260a6b62ac03 req-fb8dfd8f-e4e8-48a0-9d2e-b81f9c6690c4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060720 Apr 05 11:17:34.378865 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 292/571] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:17:35.038840 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f502127e-f8f2-4254-84ac-bacdd568f0db tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:35.040056 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f502127e-f8f2-4254-84ac-bacdd568f0db tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:35.053163 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f502127e-f8f2-4254-84ac-bacdd568f0db tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:35.053393 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a5bdeb01-2f41-42aa-8875-ab1b48a27481 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:35.054086 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a5bdeb01-2f41-42aa-8875-ab1b48a27481 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:35.055259 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f502127e-f8f2-4254-84ac-bacdd568f0db tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:35.056982 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f502127e-f8f2-4254-84ac-bacdd568f0db tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:35.057646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f502127e-f8f2-4254-84ac-bacdd568f0db tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:35.060751 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5bdeb01-2f41-42aa-8875-ab1b48a27481 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:35.061240 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5bdeb01-2f41-42aa-8875-ab1b48a27481 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:35.071677 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5bdeb01-2f41-42aa-8875-ab1b48a27481 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:35.071677 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5bdeb01-2f41-42aa-8875-ab1b48a27481 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:35.317658 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a5bdeb01-2f41-42aa-8875-ab1b48a27481 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:35.326324 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a5bdeb01-2f41-42aa-8875-ab1b48a27481 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.276976 Apr 05 11:17:35.337688 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 293/572] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:35 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:35.344120 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8857852a-08df-4ba5-9caa-5d204cd381e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:35.344917 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8857852a-08df-4ba5-9caa-5d204cd381e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:35.351475 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8857852a-08df-4ba5-9caa-5d204cd381e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:35.352150 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8857852a-08df-4ba5-9caa-5d204cd381e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:35.353108 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8857852a-08df-4ba5-9caa-5d204cd381e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:35.353724 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8857852a-08df-4ba5-9caa-5d204cd381e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:35.501418 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f502127e-f8f2-4254-84ac-bacdd568f0db tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:35.510444 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f502127e-f8f2-4254-84ac-bacdd568f0db tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:35.512965 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f502127e-f8f2-4254-84ac-bacdd568f0db tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:35.514238 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f502127e-f8f2-4254-84ac-bacdd568f0db tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.481589 Apr 05 11:17:35.514987 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 280/573] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:35 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:35.519826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-965363600", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2074523442", "security_groups": [{"name": "tempest-secgroup-smoke-1570465375"}], "networks": [{"uuid": "dcecadc1-803f-40fe-91be-b25ccccfa953"}], "block_device_mapping_v2": [{"uuid": "5019cbfb-284e-4927-87f7-7b3b44359301", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:35.668941 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] validate_networks() for [('dcecadc1-803f-40fe-91be-b25ccccfa953', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:17:35.716470 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8857852a-08df-4ba5-9caa-5d204cd381e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:35.736487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8857852a-08df-4ba5-9caa-5d204cd381e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.396613 Apr 05 11:17:35.738761 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 294/574] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:35 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:35.745199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-c914f721-4874-48e7-8c00-cdcb251f50a9 req-31ee6c5a-21fe-4e5e-8faa-33bdc95730d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7680ed-da15-498a-a57d-a37e492ada5b", "tag": "141f21be-2523-4672-a366-4a146e7780e9"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:35.755571 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c914f721-4874-48e7-8c00-cdcb251f50a9 req-31ee6c5a-21fe-4e5e-8faa-33bdc95730d7 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:35.756686 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c914f721-4874-48e7-8c00-cdcb251f50a9 req-31ee6c5a-21fe-4e5e-8faa-33bdc95730d7 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:35.770200 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-c914f721-4874-48e7-8c00-cdcb251f50a9 req-31ee6c5a-21fe-4e5e-8faa-33bdc95730d7 service nova] Creating event network-changed:141f21be-2523-4672-a366-4a146e7780e9 for instance 0d7680ed-da15-498a-a57d-a37e492ada5b on hv-cinder-81899 Apr 05 11:17:35.775282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-c914f721-4874-48e7-8c00-cdcb251f50a9 req-31ee6c5a-21fe-4e5e-8faa-33bdc95730d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035089 Apr 05 11:17:35.776399 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 295/575] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:17:36.120631 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:17:36.121122 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:17:36.121504 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:17:36.121917 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:17:36.122378 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:17:36.131307 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:36.131750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:36.132547 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:36.132978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:36.149118 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Getting quotas for project b3e907fc457e4c4396437b93bfa31859. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:17:36.153322 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Getting quotas for user a33726523008433e826ed90d0ae5e81d and project b3e907fc457e4c4396437b93bfa31859. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:17:36.209631 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:17:36.211748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5019cbfb-284e-4927-87f7-7b3b44359301',volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:17:36.351082 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7012e09b-2bed-4a7d-885d-50a222143991 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:36.352817 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7012e09b-2bed-4a7d-885d-50a222143991 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:36.361197 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7012e09b-2bed-4a7d-885d-50a222143991 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:36.361710 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7012e09b-2bed-4a7d-885d-50a222143991 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:36.362762 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7012e09b-2bed-4a7d-885d-50a222143991 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:36.363499 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7012e09b-2bed-4a7d-885d-50a222143991 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:36.555803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7012e09b-2bed-4a7d-885d-50a222143991 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:36.585679 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7012e09b-2bed-4a7d-885d-50a222143991 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.244224 Apr 05 11:17:36.591278 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 296/576] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:36 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:36.600401 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0e36cf94-6a89-461b-b8ab-32529856ef3c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:36.601916 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0e36cf94-6a89-461b-b8ab-32529856ef3c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:36.618075 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0e36cf94-6a89-461b-b8ab-32529856ef3c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:36.618520 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0e36cf94-6a89-461b-b8ab-32529856ef3c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:36.619601 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0e36cf94-6a89-461b-b8ab-32529856ef3c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:36.620467 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0e36cf94-6a89-461b-b8ab-32529856ef3c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:36.755551 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5c44a1ef-3498-47ef-be89-5c2460a4ad9d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.239300 Apr 05 11:17:36.756931 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 281/577] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:17:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:17:36.764296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-00feff0d-4e27-4db9-8801-d0667e4b57a5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:36.765203 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-00feff0d-4e27-4db9-8801-d0667e4b57a5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:36.773050 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00feff0d-4e27-4db9-8801-d0667e4b57a5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:36.773789 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00feff0d-4e27-4db9-8801-d0667e4b57a5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:36.774814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00feff0d-4e27-4db9-8801-d0667e4b57a5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:36.776069 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00feff0d-4e27-4db9-8801-d0667e4b57a5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:36.795675 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0e36cf94-6a89-461b-b8ab-32529856ef3c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:36.805107 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0e36cf94-6a89-461b-b8ab-32529856ef3c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:36.812065 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0e36cf94-6a89-461b-b8ab-32529856ef3c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:36.814460 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0e36cf94-6a89-461b-b8ab-32529856ef3c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.221604 Apr 05 11:17:36.825588 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 297/578] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:36 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:36.825588 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3a443c67-ab8e-4d6e-93d0-53f2129bb3d4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:36.825588 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3a443c67-ab8e-4d6e-93d0-53f2129bb3d4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:36.888397 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3a443c67-ab8e-4d6e-93d0-53f2129bb3d4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:36.897091 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3a443c67-ab8e-4d6e-93d0-53f2129bb3d4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1088 microversion: 2.1 time: 0.080388 Apr 05 11:17:36.898200 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 298/579] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:36 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:36.999147 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-00feff0d-4e27-4db9-8801-d0667e4b57a5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:37.007686 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-00feff0d-4e27-4db9-8801-d0667e4b57a5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.249264 Apr 05 11:17:37.027589 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 282/580] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:36 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:37.607729 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-40ca9795-037d-4bda-b389-aae7b5c8b9e8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:37.608282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-40ca9795-037d-4bda-b389-aae7b5c8b9e8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:37.614857 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-40ca9795-037d-4bda-b389-aae7b5c8b9e8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:37.615648 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-40ca9795-037d-4bda-b389-aae7b5c8b9e8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:37.616607 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-40ca9795-037d-4bda-b389-aae7b5c8b9e8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:37.617087 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-40ca9795-037d-4bda-b389-aae7b5c8b9e8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:37.783482 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-40ca9795-037d-4bda-b389-aae7b5c8b9e8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:37.791815 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-40ca9795-037d-4bda-b389-aae7b5c8b9e8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.187812 Apr 05 11:17:37.795070 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 299/581] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:37 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:37.836221 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-039b56bf-f863-478c-9371-44a2a0b009a1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:37.836221 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-039b56bf-f863-478c-9371-44a2a0b009a1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:37.841924 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-039b56bf-f863-478c-9371-44a2a0b009a1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:37.842386 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-039b56bf-f863-478c-9371-44a2a0b009a1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:37.843241 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-039b56bf-f863-478c-9371-44a2a0b009a1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:37.843871 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-039b56bf-f863-478c-9371-44a2a0b009a1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:37.919189 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e0701c4e-9b49-4ba0-8ca8-75f37ea53516 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:37.921573 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e0701c4e-9b49-4ba0-8ca8-75f37ea53516 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:38.014774 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-039b56bf-f863-478c-9371-44a2a0b009a1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:38.022287 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e0701c4e-9b49-4ba0-8ca8-75f37ea53516 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:38.029960 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-039b56bf-f863-478c-9371-44a2a0b009a1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:38.031508 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-039b56bf-f863-478c-9371-44a2a0b009a1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:38.034390 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e0701c4e-9b49-4ba0-8ca8-75f37ea53516 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1088 microversion: 2.1 time: 0.122102 Apr 05 11:17:38.034747 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-039b56bf-f863-478c-9371-44a2a0b009a1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.204758 Apr 05 11:17:38.035543 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 300/582] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:37 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1088 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:38.035904 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 283/583] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:37 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:38.053210 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ecd63971-47bd-4897-8ed2-88f14dd8a1b4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:38.054160 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ecd63971-47bd-4897-8ed2-88f14dd8a1b4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:38.060615 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ecd63971-47bd-4897-8ed2-88f14dd8a1b4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:38.061071 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ecd63971-47bd-4897-8ed2-88f14dd8a1b4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:38.061852 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ecd63971-47bd-4897-8ed2-88f14dd8a1b4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:38.062402 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ecd63971-47bd-4897-8ed2-88f14dd8a1b4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:38.224749 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ecd63971-47bd-4897-8ed2-88f14dd8a1b4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:38.233243 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ecd63971-47bd-4897-8ed2-88f14dd8a1b4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.184082 Apr 05 11:17:38.243043 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 301/584] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:38 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:38.809840 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-646a5227-dc36-4df2-bb50-e78c5ed233f1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:38.810453 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-646a5227-dc36-4df2-bb50-e78c5ed233f1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:38.816459 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-646a5227-dc36-4df2-bb50-e78c5ed233f1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:38.816907 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-646a5227-dc36-4df2-bb50-e78c5ed233f1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:38.817672 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-646a5227-dc36-4df2-bb50-e78c5ed233f1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:38.818111 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-646a5227-dc36-4df2-bb50-e78c5ed233f1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:38.953076 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-646a5227-dc36-4df2-bb50-e78c5ed233f1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:38.960395 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-646a5227-dc36-4df2-bb50-e78c5ed233f1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.155050 Apr 05 11:17:38.962765 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 284/585] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:38 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:39.053173 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-38619a18-6227-4bdd-9268-c2c5574656c5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:39.053775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-38619a18-6227-4bdd-9268-c2c5574656c5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:39.054875 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5104cb5f-37ff-4d9a-b429-9d6cf5425e42 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:39.055487 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5104cb5f-37ff-4d9a-b429-9d6cf5425e42 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:39.060730 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38619a18-6227-4bdd-9268-c2c5574656c5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:39.061178 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38619a18-6227-4bdd-9268-c2c5574656c5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:39.061941 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38619a18-6227-4bdd-9268-c2c5574656c5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:39.062059 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5104cb5f-37ff-4d9a-b429-9d6cf5425e42 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:39.062415 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38619a18-6227-4bdd-9268-c2c5574656c5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:39.062543 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5104cb5f-37ff-4d9a-b429-9d6cf5425e42 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:39.063196 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5104cb5f-37ff-4d9a-b429-9d6cf5425e42 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:39.063633 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5104cb5f-37ff-4d9a-b429-9d6cf5425e42 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:39.122423 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5104cb5f-37ff-4d9a-b429-9d6cf5425e42 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:39.130088 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5104cb5f-37ff-4d9a-b429-9d6cf5425e42 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1138 microversion: 2.1 time: 0.078928 Apr 05 11:17:39.130701 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 285/586] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:39 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1138 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:39.205176 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-38619a18-6227-4bdd-9268-c2c5574656c5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:39.212902 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-38619a18-6227-4bdd-9268-c2c5574656c5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:39.214971 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-38619a18-6227-4bdd-9268-c2c5574656c5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:39.216115 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-38619a18-6227-4bdd-9268-c2c5574656c5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.166821 Apr 05 11:17:39.219712 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 302/587] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:39 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:39.250992 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c4e32dcd-feef-40f3-aa6a-1d2d52212df3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:39.251613 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c4e32dcd-feef-40f3-aa6a-1d2d52212df3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:39.258256 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c4e32dcd-feef-40f3-aa6a-1d2d52212df3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:39.258505 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c4e32dcd-feef-40f3-aa6a-1d2d52212df3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:39.259312 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c4e32dcd-feef-40f3-aa6a-1d2d52212df3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:39.259743 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c4e32dcd-feef-40f3-aa6a-1d2d52212df3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:39.408051 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c4e32dcd-feef-40f3-aa6a-1d2d52212df3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:39.415365 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c4e32dcd-feef-40f3-aa6a-1d2d52212df3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.168341 Apr 05 11:17:39.425387 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 286/588] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:39 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:39.977056 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f0f14564-eba1-49d9-886e-efeaebb79f66 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:39.977578 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f0f14564-eba1-49d9-886e-efeaebb79f66 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:39.983470 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0f14564-eba1-49d9-886e-efeaebb79f66 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:39.989410 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0f14564-eba1-49d9-886e-efeaebb79f66 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:39.989410 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0f14564-eba1-49d9-886e-efeaebb79f66 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:39.989410 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0f14564-eba1-49d9-886e-efeaebb79f66 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:40.114973 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f0f14564-eba1-49d9-886e-efeaebb79f66 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:40.123155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f0f14564-eba1-49d9-886e-efeaebb79f66 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.149945 Apr 05 11:17:40.123717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 303/589] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:39 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:40.146115 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-809484e6-280a-49d5-b688-e72e38957396 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:40.146750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-809484e6-280a-49d5-b688-e72e38957396 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:40.152994 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-809484e6-280a-49d5-b688-e72e38957396 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:40.153446 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-809484e6-280a-49d5-b688-e72e38957396 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:40.154235 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-809484e6-280a-49d5-b688-e72e38957396 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:40.154675 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-809484e6-280a-49d5-b688-e72e38957396 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:40.215221 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-809484e6-280a-49d5-b688-e72e38957396 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:40.222911 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-809484e6-280a-49d5-b688-e72e38957396 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1138 microversion: 2.1 time: 0.080654 Apr 05 11:17:40.223485 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 287/590] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:40 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:40.236627 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ff9d41c5-9938-4ac4-af5b-f4396e5fa126 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:40.237169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ff9d41c5-9938-4ac4-af5b-f4396e5fa126 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:40.243192 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff9d41c5-9938-4ac4-af5b-f4396e5fa126 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:40.243642 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff9d41c5-9938-4ac4-af5b-f4396e5fa126 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:40.244406 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff9d41c5-9938-4ac4-af5b-f4396e5fa126 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:40.245595 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff9d41c5-9938-4ac4-af5b-f4396e5fa126 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:40.384497 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ff9d41c5-9938-4ac4-af5b-f4396e5fa126 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:40.391671 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ff9d41c5-9938-4ac4-af5b-f4396e5fa126 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:40.393259 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ff9d41c5-9938-4ac4-af5b-f4396e5fa126 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:40.394416 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ff9d41c5-9938-4ac4-af5b-f4396e5fa126 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.161758 Apr 05 11:17:40.395097 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 304/591] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:40 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:40.433477 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6db412ac-d9fc-4cab-828e-e50ca1322449 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:40.434085 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6db412ac-d9fc-4cab-828e-e50ca1322449 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:40.439963 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6db412ac-d9fc-4cab-828e-e50ca1322449 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:40.440411 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6db412ac-d9fc-4cab-828e-e50ca1322449 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:40.441364 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6db412ac-d9fc-4cab-828e-e50ca1322449 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:40.441816 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6db412ac-d9fc-4cab-828e-e50ca1322449 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:40.572735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6db412ac-d9fc-4cab-828e-e50ca1322449 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:40.580000 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6db412ac-d9fc-4cab-828e-e50ca1322449 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.151162 Apr 05 11:17:40.580561 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 288/592] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:40 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:41.140676 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f55532b8-e7f1-4238-a3aa-22c1d56a3366 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:41.141327 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f55532b8-e7f1-4238-a3aa-22c1d56a3366 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:41.147662 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f55532b8-e7f1-4238-a3aa-22c1d56a3366 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:41.148088 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f55532b8-e7f1-4238-a3aa-22c1d56a3366 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:41.148852 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f55532b8-e7f1-4238-a3aa-22c1d56a3366 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:41.149286 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f55532b8-e7f1-4238-a3aa-22c1d56a3366 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:41.239391 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-73c46605-5b2a-4317-9c48-3f9b6f3e6e54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:41.240067 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-73c46605-5b2a-4317-9c48-3f9b6f3e6e54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:41.246597 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73c46605-5b2a-4317-9c48-3f9b6f3e6e54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:41.247085 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73c46605-5b2a-4317-9c48-3f9b6f3e6e54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:41.251296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73c46605-5b2a-4317-9c48-3f9b6f3e6e54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:41.251296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73c46605-5b2a-4317-9c48-3f9b6f3e6e54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:41.280766 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f55532b8-e7f1-4238-a3aa-22c1d56a3366 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:41.289738 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f55532b8-e7f1-4238-a3aa-22c1d56a3366 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.153126 Apr 05 11:17:41.297001 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 305/593] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:41 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:41.309444 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-73c46605-5b2a-4317-9c48-3f9b6f3e6e54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:41.317017 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-73c46605-5b2a-4317-9c48-3f9b6f3e6e54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1138 microversion: 2.1 time: 0.081372 Apr 05 11:17:41.317580 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 289/594] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:41 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:41.412937 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e037d57d-b5a2-4376-9a45-bf536a6b5397 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:41.413469 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e037d57d-b5a2-4376-9a45-bf536a6b5397 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:41.419406 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e037d57d-b5a2-4376-9a45-bf536a6b5397 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:41.419858 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e037d57d-b5a2-4376-9a45-bf536a6b5397 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:41.420673 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e037d57d-b5a2-4376-9a45-bf536a6b5397 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:41.421121 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e037d57d-b5a2-4376-9a45-bf536a6b5397 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:41.557180 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e037d57d-b5a2-4376-9a45-bf536a6b5397 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:41.566065 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e037d57d-b5a2-4376-9a45-bf536a6b5397 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:41.567736 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e037d57d-b5a2-4376-9a45-bf536a6b5397 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:41.568888 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e037d57d-b5a2-4376-9a45-bf536a6b5397 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.159949 Apr 05 11:17:41.569457 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 306/595] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:41 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:41.596739 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-31f1f91b-9fc8-4d11-a8a2-cd6be66e6ddd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:41.600584 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-31f1f91b-9fc8-4d11-a8a2-cd6be66e6ddd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:41.603302 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-31f1f91b-9fc8-4d11-a8a2-cd6be66e6ddd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:41.603743 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-31f1f91b-9fc8-4d11-a8a2-cd6be66e6ddd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:41.604508 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-31f1f91b-9fc8-4d11-a8a2-cd6be66e6ddd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:41.604935 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-31f1f91b-9fc8-4d11-a8a2-cd6be66e6ddd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:41.739217 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-31f1f91b-9fc8-4d11-a8a2-cd6be66e6ddd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:41.747306 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-31f1f91b-9fc8-4d11-a8a2-cd6be66e6ddd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.154551 Apr 05 11:17:41.747879 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 290/596] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:41 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:42.306784 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-df5335bd-40de-4015-9acd-7453e89da44e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:42.307396 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-df5335bd-40de-4015-9acd-7453e89da44e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:42.313849 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df5335bd-40de-4015-9acd-7453e89da44e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:42.314295 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df5335bd-40de-4015-9acd-7453e89da44e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:42.315082 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df5335bd-40de-4015-9acd-7453e89da44e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:42.315514 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df5335bd-40de-4015-9acd-7453e89da44e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:42.334051 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1dbf3f50-575b-4a9f-998a-e83ff1669494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:42.334687 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1dbf3f50-575b-4a9f-998a-e83ff1669494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:42.341536 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1dbf3f50-575b-4a9f-998a-e83ff1669494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:42.341991 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1dbf3f50-575b-4a9f-998a-e83ff1669494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:42.342839 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1dbf3f50-575b-4a9f-998a-e83ff1669494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:42.343284 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1dbf3f50-575b-4a9f-998a-e83ff1669494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:42.401979 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1dbf3f50-575b-4a9f-998a-e83ff1669494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:42.409724 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1dbf3f50-575b-4a9f-998a-e83ff1669494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1138 microversion: 2.1 time: 0.079447 Apr 05 11:17:42.410232 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 291/597] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:42 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1138 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:42.448497 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-df5335bd-40de-4015-9acd-7453e89da44e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:42.455730 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-df5335bd-40de-4015-9acd-7453e89da44e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.152746 Apr 05 11:17:42.460551 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 307/598] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:42 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:42.587005 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cdd2b055-c64e-4217-97b5-758963c7c7a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:42.587615 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cdd2b055-c64e-4217-97b5-758963c7c7a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:42.593474 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cdd2b055-c64e-4217-97b5-758963c7c7a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:42.593923 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cdd2b055-c64e-4217-97b5-758963c7c7a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:42.594718 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cdd2b055-c64e-4217-97b5-758963c7c7a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:42.595154 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cdd2b055-c64e-4217-97b5-758963c7c7a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:42.724510 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cdd2b055-c64e-4217-97b5-758963c7c7a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:42.732772 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cdd2b055-c64e-4217-97b5-758963c7c7a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:42.734256 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cdd2b055-c64e-4217-97b5-758963c7c7a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:42.735419 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cdd2b055-c64e-4217-97b5-758963c7c7a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.152309 Apr 05 11:17:42.735974 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 292/599] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:42 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:42.764464 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4ab4ed53-f465-496d-8cf8-6fbc9d6e32a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:42.765064 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4ab4ed53-f465-496d-8cf8-6fbc9d6e32a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:42.770925 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ab4ed53-f465-496d-8cf8-6fbc9d6e32a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:42.771371 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ab4ed53-f465-496d-8cf8-6fbc9d6e32a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:42.772120 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ab4ed53-f465-496d-8cf8-6fbc9d6e32a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:42.772549 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ab4ed53-f465-496d-8cf8-6fbc9d6e32a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:42.904703 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4ab4ed53-f465-496d-8cf8-6fbc9d6e32a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:42.911919 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4ab4ed53-f465-496d-8cf8-6fbc9d6e32a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.151374 Apr 05 11:17:42.912479 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 308/600] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:42 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:43.427007 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-39025a27-5955-4191-adbc-1425ef2169df tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:43.427538 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-39025a27-5955-4191-adbc-1425ef2169df tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:43.434436 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39025a27-5955-4191-adbc-1425ef2169df tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:43.434915 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39025a27-5955-4191-adbc-1425ef2169df tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:43.435849 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39025a27-5955-4191-adbc-1425ef2169df tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:43.436296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39025a27-5955-4191-adbc-1425ef2169df tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:43.475789 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1570e487-61f9-43d4-81b4-b4da6d2759a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:43.476403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1570e487-61f9-43d4-81b4-b4da6d2759a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:43.483252 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1570e487-61f9-43d4-81b4-b4da6d2759a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:43.483701 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1570e487-61f9-43d4-81b4-b4da6d2759a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:43.484496 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1570e487-61f9-43d4-81b4-b4da6d2759a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:43.484931 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1570e487-61f9-43d4-81b4-b4da6d2759a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:43.498296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-39025a27-5955-4191-adbc-1425ef2169df tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:43.505695 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-39025a27-5955-4191-adbc-1425ef2169df tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1138 microversion: 2.1 time: 0.082591 Apr 05 11:17:43.506355 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 293/601] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:43 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:43.625278 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1570e487-61f9-43d4-81b4-b4da6d2759a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:43.632605 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1570e487-61f9-43d4-81b4-b4da6d2759a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.160689 Apr 05 11:17:43.633166 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 309/602] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:43 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:43.754377 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0a866727-e279-4308-9fd6-a9b2758cb746 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:43.755004 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0a866727-e279-4308-9fd6-a9b2758cb746 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:43.761014 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a866727-e279-4308-9fd6-a9b2758cb746 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:43.761461 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a866727-e279-4308-9fd6-a9b2758cb746 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:43.762257 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a866727-e279-4308-9fd6-a9b2758cb746 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:43.762695 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a866727-e279-4308-9fd6-a9b2758cb746 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:43.894382 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0a866727-e279-4308-9fd6-a9b2758cb746 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:43.902512 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0a866727-e279-4308-9fd6-a9b2758cb746 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:43.904056 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0a866727-e279-4308-9fd6-a9b2758cb746 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:43.905189 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0a866727-e279-4308-9fd6-a9b2758cb746 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.154708 Apr 05 11:17:43.905750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 294/603] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:43 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:43.928405 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e8bb656b-af69-4d62-9d61-88ef265faabc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:43.929019 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e8bb656b-af69-4d62-9d61-88ef265faabc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:43.935379 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e8bb656b-af69-4d62-9d61-88ef265faabc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:43.935829 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e8bb656b-af69-4d62-9d61-88ef265faabc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:43.936588 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e8bb656b-af69-4d62-9d61-88ef265faabc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:43.937025 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e8bb656b-af69-4d62-9d61-88ef265faabc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:44.069454 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e8bb656b-af69-4d62-9d61-88ef265faabc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:44.076823 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e8bb656b-af69-4d62-9d61-88ef265faabc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.152241 Apr 05 11:17:44.077383 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 310/604] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:43 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:44.522687 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-51b26da1-23f1-4fbb-b412-47bd98a9c678 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:44.523346 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-51b26da1-23f1-4fbb-b412-47bd98a9c678 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:44.530117 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-51b26da1-23f1-4fbb-b412-47bd98a9c678 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:44.530563 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-51b26da1-23f1-4fbb-b412-47bd98a9c678 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:44.531352 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-51b26da1-23f1-4fbb-b412-47bd98a9c678 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:44.531790 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-51b26da1-23f1-4fbb-b412-47bd98a9c678 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:44.589324 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-51b26da1-23f1-4fbb-b412-47bd98a9c678 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:44.597211 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-51b26da1-23f1-4fbb-b412-47bd98a9c678 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1138 microversion: 2.1 time: 0.078397 Apr 05 11:17:44.597784 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 295/605] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:44 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1138 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:44.649006 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5d851eb6-284f-4d4b-ac13-c2db2d9d69f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:44.649604 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5d851eb6-284f-4d4b-ac13-c2db2d9d69f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:44.656841 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5d851eb6-284f-4d4b-ac13-c2db2d9d69f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:44.657285 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5d851eb6-284f-4d4b-ac13-c2db2d9d69f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:44.658044 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5d851eb6-284f-4d4b-ac13-c2db2d9d69f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:44.658474 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5d851eb6-284f-4d4b-ac13-c2db2d9d69f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:44.790297 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5d851eb6-284f-4d4b-ac13-c2db2d9d69f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:44.797665 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5d851eb6-284f-4d4b-ac13-c2db2d9d69f0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.152465 Apr 05 11:17:44.798224 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 311/606] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:44 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:44.923416 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c5b88e7d-b7aa-4754-95e6-2b6f740d4e3d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:44.923937 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c5b88e7d-b7aa-4754-95e6-2b6f740d4e3d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:44.930136 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5b88e7d-b7aa-4754-95e6-2b6f740d4e3d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:44.930580 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5b88e7d-b7aa-4754-95e6-2b6f740d4e3d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:44.931361 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5b88e7d-b7aa-4754-95e6-2b6f740d4e3d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:44.931792 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5b88e7d-b7aa-4754-95e6-2b6f740d4e3d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:45.062954 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c5b88e7d-b7aa-4754-95e6-2b6f740d4e3d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:45.070790 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c5b88e7d-b7aa-4754-95e6-2b6f740d4e3d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:45.072304 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c5b88e7d-b7aa-4754-95e6-2b6f740d4e3d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:45.073448 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c5b88e7d-b7aa-4754-95e6-2b6f740d4e3d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.154082 Apr 05 11:17:45.074008 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 296/607] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:44 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:45.093861 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f8073e3e-44ed-4fea-9177-3f8c4113a79e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:45.094496 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f8073e3e-44ed-4fea-9177-3f8c4113a79e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:45.100480 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f8073e3e-44ed-4fea-9177-3f8c4113a79e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:45.100932 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f8073e3e-44ed-4fea-9177-3f8c4113a79e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:45.101690 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f8073e3e-44ed-4fea-9177-3f8c4113a79e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:45.102127 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f8073e3e-44ed-4fea-9177-3f8c4113a79e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:45.234626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f8073e3e-44ed-4fea-9177-3f8c4113a79e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:45.242277 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f8073e3e-44ed-4fea-9177-3f8c4113a79e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.152838 Apr 05 11:17:45.242888 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 312/608] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:45 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:45.614836 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ca54c0e6-742d-447e-8b1a-de8af1147548 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:45.615513 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ca54c0e6-742d-447e-8b1a-de8af1147548 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:45.622150 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca54c0e6-742d-447e-8b1a-de8af1147548 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:45.622622 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca54c0e6-742d-447e-8b1a-de8af1147548 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:45.623395 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca54c0e6-742d-447e-8b1a-de8af1147548 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:45.623834 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca54c0e6-742d-447e-8b1a-de8af1147548 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:45.682149 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ca54c0e6-742d-447e-8b1a-de8af1147548 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:45.689572 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ca54c0e6-742d-447e-8b1a-de8af1147548 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1138 microversion: 2.1 time: 0.078927 Apr 05 11:17:45.690132 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 297/609] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:45 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1138 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:45.814272 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-61f2da42-e2ed-48e4-ae4e-d2216736117e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:45.814903 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-61f2da42-e2ed-48e4-ae4e-d2216736117e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:45.821183 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61f2da42-e2ed-48e4-ae4e-d2216736117e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:45.821631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61f2da42-e2ed-48e4-ae4e-d2216736117e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:45.822398 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61f2da42-e2ed-48e4-ae4e-d2216736117e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:45.822861 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61f2da42-e2ed-48e4-ae4e-d2216736117e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:45.954975 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-61f2da42-e2ed-48e4-ae4e-d2216736117e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:45.962365 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-61f2da42-e2ed-48e4-ae4e-d2216736117e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.152093 Apr 05 11:17:45.962975 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 313/610] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:45 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:46.091284 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-95e6c0fc-ddbf-4a34-8917-bcc2cc2e2e7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:46.091893 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-95e6c0fc-ddbf-4a34-8917-bcc2cc2e2e7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:46.097839 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-95e6c0fc-ddbf-4a34-8917-bcc2cc2e2e7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:46.098290 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-95e6c0fc-ddbf-4a34-8917-bcc2cc2e2e7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:46.099097 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-95e6c0fc-ddbf-4a34-8917-bcc2cc2e2e7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:46.099535 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-95e6c0fc-ddbf-4a34-8917-bcc2cc2e2e7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:46.228484 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-95e6c0fc-ddbf-4a34-8917-bcc2cc2e2e7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:46.236223 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-95e6c0fc-ddbf-4a34-8917-bcc2cc2e2e7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:46.237767 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-95e6c0fc-ddbf-4a34-8917-bcc2cc2e2e7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:46.238944 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-95e6c0fc-ddbf-4a34-8917-bcc2cc2e2e7a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.151472 Apr 05 11:17:46.239514 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 298/611] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:46 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:46.259897 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0fb925bd-ef0e-45cb-ac36-e763b35a7799 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:46.260511 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0fb925bd-ef0e-45cb-ac36-e763b35a7799 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:46.267104 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0fb925bd-ef0e-45cb-ac36-e763b35a7799 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:46.267564 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0fb925bd-ef0e-45cb-ac36-e763b35a7799 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:46.268368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0fb925bd-ef0e-45cb-ac36-e763b35a7799 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:46.269093 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0fb925bd-ef0e-45cb-ac36-e763b35a7799 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:46.437856 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0fb925bd-ef0e-45cb-ac36-e763b35a7799 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:46.445852 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0fb925bd-ef0e-45cb-ac36-e763b35a7799 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.189764 Apr 05 11:17:46.446442 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 314/612] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:46 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:46.705934 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bde70f2f-3de8-4096-8cde-1845e1bb9957 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:46.706767 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bde70f2f-3de8-4096-8cde-1845e1bb9957 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:46.713210 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bde70f2f-3de8-4096-8cde-1845e1bb9957 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:46.713712 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bde70f2f-3de8-4096-8cde-1845e1bb9957 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:46.720963 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bde70f2f-3de8-4096-8cde-1845e1bb9957 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:46.720963 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bde70f2f-3de8-4096-8cde-1845e1bb9957 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:46.779666 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bde70f2f-3de8-4096-8cde-1845e1bb9957 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:46.788126 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bde70f2f-3de8-4096-8cde-1845e1bb9957 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1138 microversion: 2.1 time: 0.085703 Apr 05 11:17:46.788698 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 299/613] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:46 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:46.979655 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-80126000-5c0e-422c-9759-93bf638acc09 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:46.980259 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-80126000-5c0e-422c-9759-93bf638acc09 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:46.986686 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80126000-5c0e-422c-9759-93bf638acc09 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:46.987137 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80126000-5c0e-422c-9759-93bf638acc09 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:46.995460 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80126000-5c0e-422c-9759-93bf638acc09 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:46.995460 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80126000-5c0e-422c-9759-93bf638acc09 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:47.194762 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-80126000-5c0e-422c-9759-93bf638acc09 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:47.203205 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-80126000-5c0e-422c-9759-93bf638acc09 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.227565 Apr 05 11:17:47.203800 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 315/614] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:46 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:47.257269 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d06502a3-53db-4cf2-a68e-f8688b49af46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:47.257865 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d06502a3-53db-4cf2-a68e-f8688b49af46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:47.265379 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d06502a3-53db-4cf2-a68e-f8688b49af46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:47.275826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d06502a3-53db-4cf2-a68e-f8688b49af46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:47.275826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d06502a3-53db-4cf2-a68e-f8688b49af46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:47.275826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d06502a3-53db-4cf2-a68e-f8688b49af46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:47.413023 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d06502a3-53db-4cf2-a68e-f8688b49af46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:47.421187 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d06502a3-53db-4cf2-a68e-f8688b49af46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:47.422709 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d06502a3-53db-4cf2-a68e-f8688b49af46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:47.423857 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d06502a3-53db-4cf2-a68e-f8688b49af46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1742 microversion: 2.20 time: 0.170513 Apr 05 11:17:47.424428 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 300/615] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:47 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:47.462887 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-156aa04d-ff0f-4aa6-9ee6-51664d393d22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:47.463441 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-156aa04d-ff0f-4aa6-9ee6-51664d393d22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:47.469208 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-156aa04d-ff0f-4aa6-9ee6-51664d393d22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:47.469657 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-156aa04d-ff0f-4aa6-9ee6-51664d393d22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:47.470436 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-156aa04d-ff0f-4aa6-9ee6-51664d393d22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:47.471182 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-156aa04d-ff0f-4aa6-9ee6-51664d393d22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:47.605589 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-156aa04d-ff0f-4aa6-9ee6-51664d393d22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:47.612785 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-156aa04d-ff0f-4aa6-9ee6-51664d393d22 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.153959 Apr 05 11:17:47.613351 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 316/616] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:47 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:47.805376 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cdd9d552-b975-46ad-b76a-7383e6d9c3d7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:47.806170 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cdd9d552-b975-46ad-b76a-7383e6d9c3d7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:47.813109 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cdd9d552-b975-46ad-b76a-7383e6d9c3d7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:47.813562 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cdd9d552-b975-46ad-b76a-7383e6d9c3d7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:47.814324 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cdd9d552-b975-46ad-b76a-7383e6d9c3d7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:47.814804 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cdd9d552-b975-46ad-b76a-7383e6d9c3d7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:47.872403 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cdd9d552-b975-46ad-b76a-7383e6d9c3d7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:47.879568 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cdd9d552-b975-46ad-b76a-7383e6d9c3d7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1186 microversion: 2.1 time: 0.078038 Apr 05 11:17:47.880132 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 301/617] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:47 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1186 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:48.220586 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-28f7a2a6-c4ab-464e-9f28-43e7f9fd0acc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:48.221197 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-28f7a2a6-c4ab-464e-9f28-43e7f9fd0acc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:48.227553 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-28f7a2a6-c4ab-464e-9f28-43e7f9fd0acc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:48.228047 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-28f7a2a6-c4ab-464e-9f28-43e7f9fd0acc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:48.228846 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-28f7a2a6-c4ab-464e-9f28-43e7f9fd0acc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:48.229282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-28f7a2a6-c4ab-464e-9f28-43e7f9fd0acc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:48.367823 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-28f7a2a6-c4ab-464e-9f28-43e7f9fd0acc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:48.375781 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-28f7a2a6-c4ab-464e-9f28-43e7f9fd0acc tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.158952 Apr 05 11:17:48.376372 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 317/618] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:48 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:48.442194 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bf11d2b3-454c-4903-b0dc-a709cf7a0f88 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:48.442911 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bf11d2b3-454c-4903-b0dc-a709cf7a0f88 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:48.449084 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf11d2b3-454c-4903-b0dc-a709cf7a0f88 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:48.449557 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf11d2b3-454c-4903-b0dc-a709cf7a0f88 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:48.450449 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf11d2b3-454c-4903-b0dc-a709cf7a0f88 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:48.450835 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf11d2b3-454c-4903-b0dc-a709cf7a0f88 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:48.586328 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bf11d2b3-454c-4903-b0dc-a709cf7a0f88 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:48.596224 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bf11d2b3-454c-4903-b0dc-a709cf7a0f88 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:48.597708 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bf11d2b3-454c-4903-b0dc-a709cf7a0f88 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:48.598873 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bf11d2b3-454c-4903-b0dc-a709cf7a0f88 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.160594 Apr 05 11:17:48.599438 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 302/619] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:48 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:48.629320 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-84ef8bd2-9e74-4ef6-b0e7-75273263cede tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:48.629929 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-84ef8bd2-9e74-4ef6-b0e7-75273263cede tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:48.635763 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84ef8bd2-9e74-4ef6-b0e7-75273263cede tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:48.636214 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84ef8bd2-9e74-4ef6-b0e7-75273263cede tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:48.637472 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84ef8bd2-9e74-4ef6-b0e7-75273263cede tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:48.637956 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84ef8bd2-9e74-4ef6-b0e7-75273263cede tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:48.772195 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-84ef8bd2-9e74-4ef6-b0e7-75273263cede tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:48.780278 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-84ef8bd2-9e74-4ef6-b0e7-75273263cede tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.154916 Apr 05 11:17:48.780844 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 318/620] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:48 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:48.896638 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fe95cf17-45fb-41e1-be98-390ccc444e09 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:48.897247 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fe95cf17-45fb-41e1-be98-390ccc444e09 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:48.904215 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fe95cf17-45fb-41e1-be98-390ccc444e09 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:48.904666 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fe95cf17-45fb-41e1-be98-390ccc444e09 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:48.905476 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fe95cf17-45fb-41e1-be98-390ccc444e09 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:48.905912 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fe95cf17-45fb-41e1-be98-390ccc444e09 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:48.964214 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fe95cf17-45fb-41e1-be98-390ccc444e09 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:48.971741 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fe95cf17-45fb-41e1-be98-390ccc444e09 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1186 microversion: 2.1 time: 0.078916 Apr 05 11:17:48.972244 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 303/621] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:48 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1186 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:49.393467 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2567e94d-0c1e-4445-b849-cf581dd54d95 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:49.394079 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2567e94d-0c1e-4445-b849-cf581dd54d95 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:49.400439 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2567e94d-0c1e-4445-b849-cf581dd54d95 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:49.400886 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2567e94d-0c1e-4445-b849-cf581dd54d95 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:49.401655 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2567e94d-0c1e-4445-b849-cf581dd54d95 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:49.402091 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2567e94d-0c1e-4445-b849-cf581dd54d95 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:49.537492 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2567e94d-0c1e-4445-b849-cf581dd54d95 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:49.544840 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2567e94d-0c1e-4445-b849-cf581dd54d95 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.155357 Apr 05 11:17:49.545342 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 319/622] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:49 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:49.617264 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c2e43953-25df-46a1-9f96-c970bf47835c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:49.617902 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c2e43953-25df-46a1-9f96-c970bf47835c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:49.624026 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c2e43953-25df-46a1-9f96-c970bf47835c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:49.624480 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c2e43953-25df-46a1-9f96-c970bf47835c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:49.625235 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c2e43953-25df-46a1-9f96-c970bf47835c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:49.625671 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c2e43953-25df-46a1-9f96-c970bf47835c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:49.757105 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c2e43953-25df-46a1-9f96-c970bf47835c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:49.765008 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c2e43953-25df-46a1-9f96-c970bf47835c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:49.766573 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c2e43953-25df-46a1-9f96-c970bf47835c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:49.767730 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c2e43953-25df-46a1-9f96-c970bf47835c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.154406 Apr 05 11:17:49.772352 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 304/623] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:49 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:49.797501 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f7cb3ea7-b9a1-47df-94a6-aea9f36ce3a2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:49.798062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f7cb3ea7-b9a1-47df-94a6-aea9f36ce3a2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:49.803984 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f7cb3ea7-b9a1-47df-94a6-aea9f36ce3a2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:49.804430 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f7cb3ea7-b9a1-47df-94a6-aea9f36ce3a2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:49.805186 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f7cb3ea7-b9a1-47df-94a6-aea9f36ce3a2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:49.805614 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f7cb3ea7-b9a1-47df-94a6-aea9f36ce3a2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:49.936156 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f7cb3ea7-b9a1-47df-94a6-aea9f36ce3a2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:49.943377 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f7cb3ea7-b9a1-47df-94a6-aea9f36ce3a2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.150446 Apr 05 11:17:49.943943 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 320/624] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:49 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:49.988693 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2d8d9ea5-3717-4781-889a-125308799dbc tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:49.989290 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2d8d9ea5-3717-4781-889a-125308799dbc tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:49.995873 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d8d9ea5-3717-4781-889a-125308799dbc tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:49.996931 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d8d9ea5-3717-4781-889a-125308799dbc tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:49.997708 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d8d9ea5-3717-4781-889a-125308799dbc tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:49.998145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d8d9ea5-3717-4781-889a-125308799dbc tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:50.057139 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2d8d9ea5-3717-4781-889a-125308799dbc tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:50.064904 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2d8d9ea5-3717-4781-889a-125308799dbc tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1186 microversion: 2.1 time: 0.080067 Apr 05 11:17:50.065464 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 305/625] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:49 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1186 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:50.562415 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6de74db7-b5ba-4692-884f-4c51e9c685b6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:50.563071 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6de74db7-b5ba-4692-884f-4c51e9c685b6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:50.569349 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6de74db7-b5ba-4692-884f-4c51e9c685b6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:50.569796 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6de74db7-b5ba-4692-884f-4c51e9c685b6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:50.570558 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6de74db7-b5ba-4692-884f-4c51e9c685b6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:50.571016 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6de74db7-b5ba-4692-884f-4c51e9c685b6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:50.702825 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6de74db7-b5ba-4692-884f-4c51e9c685b6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:50.709950 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6de74db7-b5ba-4692-884f-4c51e9c685b6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.152031 Apr 05 11:17:50.710514 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 321/626] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:50 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:50.786814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f4503d33-b405-4ee8-9e4e-0d16dac6563e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:50.787416 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f4503d33-b405-4ee8-9e4e-0d16dac6563e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:50.793719 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4503d33-b405-4ee8-9e4e-0d16dac6563e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:50.794171 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4503d33-b405-4ee8-9e4e-0d16dac6563e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:50.794958 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4503d33-b405-4ee8-9e4e-0d16dac6563e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:50.795397 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4503d33-b405-4ee8-9e4e-0d16dac6563e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:50.932105 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f4503d33-b405-4ee8-9e4e-0d16dac6563e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:50.940969 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f4503d33-b405-4ee8-9e4e-0d16dac6563e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:50.942511 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f4503d33-b405-4ee8-9e4e-0d16dac6563e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:50.943698 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f4503d33-b405-4ee8-9e4e-0d16dac6563e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.160773 Apr 05 11:17:50.944277 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 306/627] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:50 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:50.960747 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-16acdfc7-384c-47ae-b2b9-91152e73abd5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:50.961369 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-16acdfc7-384c-47ae-b2b9-91152e73abd5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:50.967531 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-16acdfc7-384c-47ae-b2b9-91152e73abd5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:50.967990 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-16acdfc7-384c-47ae-b2b9-91152e73abd5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:50.968760 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-16acdfc7-384c-47ae-b2b9-91152e73abd5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:50.969200 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-16acdfc7-384c-47ae-b2b9-91152e73abd5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:51.081185 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7b0d331d-0343-4875-b5e9-a4ff1ad2164e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:51.081793 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7b0d331d-0343-4875-b5e9-a4ff1ad2164e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:51.088068 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b0d331d-0343-4875-b5e9-a4ff1ad2164e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:51.088518 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b0d331d-0343-4875-b5e9-a4ff1ad2164e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:51.089283 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b0d331d-0343-4875-b5e9-a4ff1ad2164e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:51.089726 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b0d331d-0343-4875-b5e9-a4ff1ad2164e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:51.100553 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-16acdfc7-384c-47ae-b2b9-91152e73abd5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:51.108566 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-16acdfc7-384c-47ae-b2b9-91152e73abd5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.151700 Apr 05 11:17:51.109145 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 322/628] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:50 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:51.149390 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7b0d331d-0343-4875-b5e9-a4ff1ad2164e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:51.157305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7b0d331d-0343-4875-b5e9-a4ff1ad2164e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1186 microversion: 2.1 time: 0.079949 Apr 05 11:17:51.157898 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 307/629] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:51 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1186 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:51.726810 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-41681759-7f66-4a89-9369-0259bf1da7a5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:51.727423 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-41681759-7f66-4a89-9369-0259bf1da7a5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:51.734180 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41681759-7f66-4a89-9369-0259bf1da7a5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:51.734653 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41681759-7f66-4a89-9369-0259bf1da7a5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:51.735424 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41681759-7f66-4a89-9369-0259bf1da7a5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:51.735872 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41681759-7f66-4a89-9369-0259bf1da7a5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:51.874928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-41681759-7f66-4a89-9369-0259bf1da7a5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:51.882132 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-41681759-7f66-4a89-9369-0259bf1da7a5 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.159276 Apr 05 11:17:51.882750 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 323/630] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:51 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:51.961137 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6455a622-46dc-42ea-a4e8-dd977af9cfa0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:51.961862 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6455a622-46dc-42ea-a4e8-dd977af9cfa0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:51.969256 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6455a622-46dc-42ea-a4e8-dd977af9cfa0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:51.969708 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6455a622-46dc-42ea-a4e8-dd977af9cfa0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:51.970479 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6455a622-46dc-42ea-a4e8-dd977af9cfa0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:51.970947 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6455a622-46dc-42ea-a4e8-dd977af9cfa0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:52.102001 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6455a622-46dc-42ea-a4e8-dd977af9cfa0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:52.110283 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6455a622-46dc-42ea-a4e8-dd977af9cfa0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:52.111824 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6455a622-46dc-42ea-a4e8-dd977af9cfa0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:52.112943 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6455a622-46dc-42ea-a4e8-dd977af9cfa0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.155714 Apr 05 11:17:52.113505 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 308/631] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:51 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:52.125277 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-aa5df569-0603-405d-9eff-026b6546a70a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:52.125881 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-aa5df569-0603-405d-9eff-026b6546a70a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:52.132457 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aa5df569-0603-405d-9eff-026b6546a70a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:52.132917 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aa5df569-0603-405d-9eff-026b6546a70a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:52.133698 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aa5df569-0603-405d-9eff-026b6546a70a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:52.134143 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aa5df569-0603-405d-9eff-026b6546a70a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:52.173659 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eeddfd8c-0d36-4852-8f96-eb64cd753c54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:52.174262 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eeddfd8c-0d36-4852-8f96-eb64cd753c54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:52.179988 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eeddfd8c-0d36-4852-8f96-eb64cd753c54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:52.180432 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eeddfd8c-0d36-4852-8f96-eb64cd753c54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:52.181198 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eeddfd8c-0d36-4852-8f96-eb64cd753c54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:52.181628 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eeddfd8c-0d36-4852-8f96-eb64cd753c54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:52.243255 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eeddfd8c-0d36-4852-8f96-eb64cd753c54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:52.250799 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eeddfd8c-0d36-4852-8f96-eb64cd753c54 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1186 microversion: 2.1 time: 0.080932 Apr 05 11:17:52.251906 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 309/632] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:52 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1186 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:52.269362 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-aa5df569-0603-405d-9eff-026b6546a70a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:52.276673 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-aa5df569-0603-405d-9eff-026b6546a70a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.155139 Apr 05 11:17:52.277239 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 324/633] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:52 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:52.898923 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8488e8e9-ec10-407e-86b2-4eaeb56f8a74 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:52.899528 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8488e8e9-ec10-407e-86b2-4eaeb56f8a74 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:52.905435 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8488e8e9-ec10-407e-86b2-4eaeb56f8a74 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:52.905882 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8488e8e9-ec10-407e-86b2-4eaeb56f8a74 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:52.906652 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8488e8e9-ec10-407e-86b2-4eaeb56f8a74 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:52.907085 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8488e8e9-ec10-407e-86b2-4eaeb56f8a74 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:53.040674 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8488e8e9-ec10-407e-86b2-4eaeb56f8a74 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:53.048610 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8488e8e9-ec10-407e-86b2-4eaeb56f8a74 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.153531 Apr 05 11:17:53.049175 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 310/634] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:52 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:53.131147 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-58b67080-ea6a-4aef-b226-48380a5d3c57 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:53.131855 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-58b67080-ea6a-4aef-b226-48380a5d3c57 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:53.138093 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58b67080-ea6a-4aef-b226-48380a5d3c57 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:53.146517 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58b67080-ea6a-4aef-b226-48380a5d3c57 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:53.146517 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58b67080-ea6a-4aef-b226-48380a5d3c57 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:53.146517 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58b67080-ea6a-4aef-b226-48380a5d3c57 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:53.267753 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b6902734-ef43-44eb-88eb-f94e9c5f75a8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:53.268369 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b6902734-ef43-44eb-88eb-f94e9c5f75a8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:53.268473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-58b67080-ea6a-4aef-b226-48380a5d3c57 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:53.274865 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b6902734-ef43-44eb-88eb-f94e9c5f75a8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:53.275317 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b6902734-ef43-44eb-88eb-f94e9c5f75a8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:53.276640 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b6902734-ef43-44eb-88eb-f94e9c5f75a8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:53.276640 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b6902734-ef43-44eb-88eb-f94e9c5f75a8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:53.276963 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-58b67080-ea6a-4aef-b226-48380a5d3c57 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:53.278239 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-58b67080-ea6a-4aef-b226-48380a5d3c57 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:53.279468 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-58b67080-ea6a-4aef-b226-48380a5d3c57 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.152242 Apr 05 11:17:53.280237 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 325/635] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:53 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:53.298081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6fd4ebdb-9a45-42e7-9de7-680f584ff5b3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:53.298671 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6fd4ebdb-9a45-42e7-9de7-680f584ff5b3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:53.304765 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6fd4ebdb-9a45-42e7-9de7-680f584ff5b3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:53.305219 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6fd4ebdb-9a45-42e7-9de7-680f584ff5b3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:53.306096 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6fd4ebdb-9a45-42e7-9de7-680f584ff5b3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:53.306537 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6fd4ebdb-9a45-42e7-9de7-680f584ff5b3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:53.342467 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b6902734-ef43-44eb-88eb-f94e9c5f75a8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:53.350011 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b6902734-ef43-44eb-88eb-f94e9c5f75a8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1186 microversion: 2.1 time: 0.086377 Apr 05 11:17:53.350585 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 311/636] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:53 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:53.439062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6fd4ebdb-9a45-42e7-9de7-680f584ff5b3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:53.446272 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6fd4ebdb-9a45-42e7-9de7-680f584ff5b3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.152948 Apr 05 11:17:53.446876 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 326/637] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:53 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:54.065737 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9d716138-8124-456d-8a31-6dac8b15bd62 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:54.066346 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9d716138-8124-456d-8a31-6dac8b15bd62 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:54.072501 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9d716138-8124-456d-8a31-6dac8b15bd62 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:54.072939 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9d716138-8124-456d-8a31-6dac8b15bd62 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:54.073708 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9d716138-8124-456d-8a31-6dac8b15bd62 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:54.074139 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9d716138-8124-456d-8a31-6dac8b15bd62 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:54.210707 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9d716138-8124-456d-8a31-6dac8b15bd62 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:54.218033 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9d716138-8124-456d-8a31-6dac8b15bd62 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.156756 Apr 05 11:17:54.218598 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 312/638] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:54 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:54.299106 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9b0bb098-f360-4955-a985-e99d43efde0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:54.299720 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9b0bb098-f360-4955-a985-e99d43efde0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:54.306165 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b0bb098-f360-4955-a985-e99d43efde0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:54.306625 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b0bb098-f360-4955-a985-e99d43efde0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:54.307403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b0bb098-f360-4955-a985-e99d43efde0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:54.307844 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b0bb098-f360-4955-a985-e99d43efde0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:54.367513 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a8c65f00-4e36-4476-95b0-a57a74769189 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:54.368119 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a8c65f00-4e36-4476-95b0-a57a74769189 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:54.374654 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a8c65f00-4e36-4476-95b0-a57a74769189 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:54.375118 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a8c65f00-4e36-4476-95b0-a57a74769189 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:54.375918 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a8c65f00-4e36-4476-95b0-a57a74769189 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:54.376388 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a8c65f00-4e36-4476-95b0-a57a74769189 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:54.434846 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a8c65f00-4e36-4476-95b0-a57a74769189 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:54.440448 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9b0bb098-f360-4955-a985-e99d43efde0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:54.442354 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a8c65f00-4e36-4476-95b0-a57a74769189 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1186 microversion: 2.1 time: 0.078823 Apr 05 11:17:54.443034 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 313/639] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:54 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1186 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:54.448336 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9b0bb098-f360-4955-a985-e99d43efde0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:54.450542 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9b0bb098-f360-4955-a985-e99d43efde0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:54.451821 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9b0bb098-f360-4955-a985-e99d43efde0f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.156651 Apr 05 11:17:54.452373 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 327/640] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:54 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:54.462832 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0564e284-a538-4ed0-835d-fb711fb5307b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:54.463443 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0564e284-a538-4ed0-835d-fb711fb5307b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:54.469391 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0564e284-a538-4ed0-835d-fb711fb5307b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:54.469841 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0564e284-a538-4ed0-835d-fb711fb5307b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:54.470601 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0564e284-a538-4ed0-835d-fb711fb5307b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:54.471069 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0564e284-a538-4ed0-835d-fb711fb5307b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:54.601092 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0564e284-a538-4ed0-835d-fb711fb5307b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:54.608844 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0564e284-a538-4ed0-835d-fb711fb5307b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.149781 Apr 05 11:17:54.609402 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 314/641] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:54 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:55.235344 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-695ac36a-4784-4026-9f49-9ba67acc3f46 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:55.236070 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-695ac36a-4784-4026-9f49-9ba67acc3f46 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:55.241991 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-695ac36a-4784-4026-9f49-9ba67acc3f46 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:55.242433 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-695ac36a-4784-4026-9f49-9ba67acc3f46 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:55.243223 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-695ac36a-4784-4026-9f49-9ba67acc3f46 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:55.243650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-695ac36a-4784-4026-9f49-9ba67acc3f46 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:55.375948 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-695ac36a-4784-4026-9f49-9ba67acc3f46 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:55.383043 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-695ac36a-4784-4026-9f49-9ba67acc3f46 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.152303 Apr 05 11:17:55.383607 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 328/642] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:55 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:55.459669 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7da13c04-0144-46eb-92e3-01d3ac3c2e80 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:55.460275 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7da13c04-0144-46eb-92e3-01d3ac3c2e80 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:55.466538 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7da13c04-0144-46eb-92e3-01d3ac3c2e80 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:55.467017 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7da13c04-0144-46eb-92e3-01d3ac3c2e80 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:55.475646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7da13c04-0144-46eb-92e3-01d3ac3c2e80 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:55.475646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7da13c04-0144-46eb-92e3-01d3ac3c2e80 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:55.475888 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d0f8afe9-7da6-458e-baee-c939721c6658 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:55.475888 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d0f8afe9-7da6-458e-baee-c939721c6658 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:55.478749 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0f8afe9-7da6-458e-baee-c939721c6658 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:55.479201 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0f8afe9-7da6-458e-baee-c939721c6658 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:55.479978 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0f8afe9-7da6-458e-baee-c939721c6658 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:55.480417 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0f8afe9-7da6-458e-baee-c939721c6658 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:55.533084 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7da13c04-0144-46eb-92e3-01d3ac3c2e80 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:55.539224 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7da13c04-0144-46eb-92e3-01d3ac3c2e80 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1186 microversion: 2.1 time: 0.083339 Apr 05 11:17:55.539800 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 315/643] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:55 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:55.613452 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d0f8afe9-7da6-458e-baee-c939721c6658 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:55.621479 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d0f8afe9-7da6-458e-baee-c939721c6658 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:55.623008 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d0f8afe9-7da6-458e-baee-c939721c6658 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:55.624152 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d0f8afe9-7da6-458e-baee-c939721c6658 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.158965 Apr 05 11:17:55.624748 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 329/644] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:55 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:17:55.625606 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-11bd3376-d855-4dbb-ad36-ff0e07c3ca90 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:55.626224 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-11bd3376-d855-4dbb-ad36-ff0e07c3ca90 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:55.632307 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-11bd3376-d855-4dbb-ad36-ff0e07c3ca90 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:55.632739 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-11bd3376-d855-4dbb-ad36-ff0e07c3ca90 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:55.633501 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-11bd3376-d855-4dbb-ad36-ff0e07c3ca90 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:55.633936 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-11bd3376-d855-4dbb-ad36-ff0e07c3ca90 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:55.765671 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-11bd3376-d855-4dbb-ad36-ff0e07c3ca90 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:55.773115 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-11bd3376-d855-4dbb-ad36-ff0e07c3ca90 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.151446 Apr 05 11:17:55.773674 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 316/645] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:55 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:55.839415 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-5dab820c-ee4d-494a-b7f9-158b432a145c req-ac567030-7fc0-4dfd-89b4-8c0c74b975bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c900362d-904b-4d64-a9a3-ab381ca756e3", "name": "network-vif-unplugged", "status": "completed", "tag": "be14224c-0258-4dc2-9ce4-f41347c20fc0"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:55.848087 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-5dab820c-ee4d-494a-b7f9-158b432a145c req-ac567030-7fc0-4dfd-89b4-8c0c74b975bc service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:55.848532 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-5dab820c-ee4d-494a-b7f9-158b432a145c req-ac567030-7fc0-4dfd-89b4-8c0c74b975bc service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:55.860035 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-5dab820c-ee4d-494a-b7f9-158b432a145c req-ac567030-7fc0-4dfd-89b4-8c0c74b975bc service nova] Creating event network-vif-unplugged:be14224c-0258-4dc2-9ce4-f41347c20fc0 for instance c900362d-904b-4d64-a9a3-ab381ca756e3 on hv-cinder-81899 Apr 05 11:17:55.864992 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-5dab820c-ee4d-494a-b7f9-158b432a145c req-ac567030-7fc0-4dfd-89b4-8c0c74b975bc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029300 Apr 05 11:17:55.865567 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 330/646] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:17:56.400367 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-04deb8d3-8d1f-4752-86d5-eca48cb91966 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:56.400902 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-04deb8d3-8d1f-4752-86d5-eca48cb91966 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:56.406917 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-04deb8d3-8d1f-4752-86d5-eca48cb91966 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:56.407416 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-04deb8d3-8d1f-4752-86d5-eca48cb91966 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:56.408183 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-04deb8d3-8d1f-4752-86d5-eca48cb91966 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:56.408620 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-04deb8d3-8d1f-4752-86d5-eca48cb91966 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:56.540012 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-04deb8d3-8d1f-4752-86d5-eca48cb91966 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:56.547471 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-04deb8d3-8d1f-4752-86d5-eca48cb91966 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.151100 Apr 05 11:17:56.548034 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 317/647] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:56 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:56.557082 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7ac978e2-ca95-4af4-b7c1-9e4331b1e151 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:56.557780 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7ac978e2-ca95-4af4-b7c1-9e4331b1e151 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:56.564445 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7ac978e2-ca95-4af4-b7c1-9e4331b1e151 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:56.564884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7ac978e2-ca95-4af4-b7c1-9e4331b1e151 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:56.565646 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7ac978e2-ca95-4af4-b7c1-9e4331b1e151 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:56.566083 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7ac978e2-ca95-4af4-b7c1-9e4331b1e151 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:56.624134 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7ac978e2-ca95-4af4-b7c1-9e4331b1e151 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:56.631794 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7ac978e2-ca95-4af4-b7c1-9e4331b1e151 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1186 microversion: 2.1 time: 0.079347 Apr 05 11:17:56.632359 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 331/648] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:56 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1186 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:56.642454 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9f20de32-46c9-44d6-a492-d1f95be7a045 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:56.643079 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9f20de32-46c9-44d6-a492-d1f95be7a045 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:56.648879 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9f20de32-46c9-44d6-a492-d1f95be7a045 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:56.649320 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9f20de32-46c9-44d6-a492-d1f95be7a045 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:56.650200 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9f20de32-46c9-44d6-a492-d1f95be7a045 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:56.650705 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9f20de32-46c9-44d6-a492-d1f95be7a045 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:56.783506 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9f20de32-46c9-44d6-a492-d1f95be7a045 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:56.789102 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-33ea7954-fd6d-45ff-bcd8-e2218373c9a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:56.789716 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-33ea7954-fd6d-45ff-bcd8-e2218373c9a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:56.791669 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9f20de32-46c9-44d6-a492-d1f95be7a045 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:56.793178 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9f20de32-46c9-44d6-a492-d1f95be7a045 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:56.794314 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9f20de32-46c9-44d6-a492-d1f95be7a045 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.156448 Apr 05 11:17:56.794900 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 318/649] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:56 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:56.795637 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33ea7954-fd6d-45ff-bcd8-e2218373c9a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:56.796088 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33ea7954-fd6d-45ff-bcd8-e2218373c9a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:56.797382 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33ea7954-fd6d-45ff-bcd8-e2218373c9a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:56.797824 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33ea7954-fd6d-45ff-bcd8-e2218373c9a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:56.938811 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-33ea7954-fd6d-45ff-bcd8-e2218373c9a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:56.946160 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-33ea7954-fd6d-45ff-bcd8-e2218373c9a7 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.160817 Apr 05 11:17:56.946754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 332/650] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:56 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:57.279735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2134099650", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "networks": [{"uuid": "9b0266a7-6806-42f5-be79-5cd7a53cbad0"}]}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:57.328234 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] validate_networks() for [('9b0266a7-6806-42f5-be79-5cd7a53cbad0', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:17:57.565126 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-65b62d0e-9a49-4a28-b76f-6f00ba48d807 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:57.565765 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-65b62d0e-9a49-4a28-b76f-6f00ba48d807 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:57.572588 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-65b62d0e-9a49-4a28-b76f-6f00ba48d807 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:57.573026 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-65b62d0e-9a49-4a28-b76f-6f00ba48d807 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:57.573798 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-65b62d0e-9a49-4a28-b76f-6f00ba48d807 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:57.574233 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-65b62d0e-9a49-4a28-b76f-6f00ba48d807 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:57.667681 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:17:57.668155 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:17:57.668593 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:17:57.669032 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:17:57.669443 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:17:57.679287 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:57.679740 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:57.680539 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:57.681174 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:57.698182 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Getting quotas for project cf76b11857e84565b9d171a41d7a3722. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:17:57.701897 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Getting quotas for user 4b660172403d4aadb143c04913dede54 and project cf76b11857e84565b9d171a41d7a3722. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:17:57.708818 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-65b62d0e-9a49-4a28-b76f-6f00ba48d807 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:57.712938 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:17:57.715131 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:17:57.716813 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-65b62d0e-9a49-4a28-b76f-6f00ba48d807 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.156299 Apr 05 11:17:57.717395 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 333/651] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:57 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:57.722024 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1db89bff-2a57-4307-9079-1fc9263e7bbd tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:57.722640 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1db89bff-2a57-4307-9079-1fc9263e7bbd tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:57.728214 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1db89bff-2a57-4307-9079-1fc9263e7bbd tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:57.728668 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1db89bff-2a57-4307-9079-1fc9263e7bbd tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:57.729433 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1db89bff-2a57-4307-9079-1fc9263e7bbd tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:57.729866 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1db89bff-2a57-4307-9079-1fc9263e7bbd tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:57.789102 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1db89bff-2a57-4307-9079-1fc9263e7bbd tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:57.796785 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1db89bff-2a57-4307-9079-1fc9263e7bbd tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1186 microversion: 2.1 time: 0.077954 Apr 05 11:17:57.797346 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 334/652] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:57 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1186 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:57.813554 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2e36b049-a509-4e98-9f78-abc0f6833d63 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:57.814153 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2e36b049-a509-4e98-9f78-abc0f6833d63 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:57.819968 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2e36b049-a509-4e98-9f78-abc0f6833d63 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:57.825932 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2e36b049-a509-4e98-9f78-abc0f6833d63 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:57.825932 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2e36b049-a509-4e98-9f78-abc0f6833d63 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:57.825932 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2e36b049-a509-4e98-9f78-abc0f6833d63 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:57.883749 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-53634267-f59f-41ae-bcbe-a6170b90f8cb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608053 Apr 05 11:17:57.884849 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 319/653] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:17:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:17:57.894978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0db2baf7-b956-4c69-beb5-88cae992fa96 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:57.895642 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0db2baf7-b956-4c69-beb5-88cae992fa96 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:57.951861 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0db2baf7-b956-4c69-beb5-88cae992fa96 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:57.961787 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0db2baf7-b956-4c69-beb5-88cae992fa96 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1219 microversion: 2.1 time: 0.070912 Apr 05 11:17:57.962691 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 320/654] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:57 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:57.969259 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eb12c73b-bc5c-4bf9-9a42-998e952d6914 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:57.969259 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eb12c73b-bc5c-4bf9-9a42-998e952d6914 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:57.972375 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2e36b049-a509-4e98-9f78-abc0f6833d63 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:57.974549 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb12c73b-bc5c-4bf9-9a42-998e952d6914 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:57.975038 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb12c73b-bc5c-4bf9-9a42-998e952d6914 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:57.975813 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb12c73b-bc5c-4bf9-9a42-998e952d6914 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:57.976329 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb12c73b-bc5c-4bf9-9a42-998e952d6914 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:57.985025 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2e36b049-a509-4e98-9f78-abc0f6833d63 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:57.986490 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2e36b049-a509-4e98-9f78-abc0f6833d63 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:57.987660 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2e36b049-a509-4e98-9f78-abc0f6833d63 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.178406 Apr 05 11:17:57.988576 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 335/655] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:57 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:17:58.113370 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eb12c73b-bc5c-4bf9-9a42-998e952d6914 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:58.120935 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eb12c73b-bc5c-4bf9-9a42-998e952d6914 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.157297 Apr 05 11:17:58.121555 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 321/656] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:57 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:58.710195 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-d4a035cf-6936-458b-9953-bac199ac31a0 req-81baeb0b-8633-4444-8f08-212beef0f78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83911c9a-66fa-4dc2-b353-e8367ed89f27", "name": "network-vif-plugged", "status": "completed", "tag": "41e4db55-0008-44c7-9892-ce0d8234ca56"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:17:58.722223 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-d4a035cf-6936-458b-9953-bac199ac31a0 req-81baeb0b-8633-4444-8f08-212beef0f78e service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:58.722717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-d4a035cf-6936-458b-9953-bac199ac31a0 req-81baeb0b-8633-4444-8f08-212beef0f78e service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:58.733084 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f4bc5b69-f7c5-4a61-9cae-85ea04231ca0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:58.733662 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-d4a035cf-6936-458b-9953-bac199ac31a0 req-81baeb0b-8633-4444-8f08-212beef0f78e service nova] Creating event network-vif-plugged:41e4db55-0008-44c7-9892-ce0d8234ca56 for instance 83911c9a-66fa-4dc2-b353-e8367ed89f27 on hv-cinder-81899 Apr 05 11:17:58.733961 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f4bc5b69-f7c5-4a61-9cae-85ea04231ca0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:58.739512 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-d4a035cf-6936-458b-9953-bac199ac31a0 req-81baeb0b-8633-4444-8f08-212beef0f78e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033065 Apr 05 11:17:58.740099 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 336/657] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:17:58.741194 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4bc5b69-f7c5-4a61-9cae-85ea04231ca0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:58.741760 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4bc5b69-f7c5-4a61-9cae-85ea04231ca0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:58.742904 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4bc5b69-f7c5-4a61-9cae-85ea04231ca0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:58.743349 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4bc5b69-f7c5-4a61-9cae-85ea04231ca0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:58.814783 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2d2c076c-bfdb-4db1-9671-f704e9809e4e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:58.815690 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2d2c076c-bfdb-4db1-9671-f704e9809e4e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:58.822121 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2d2c076c-bfdb-4db1-9671-f704e9809e4e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:58.825060 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2d2c076c-bfdb-4db1-9671-f704e9809e4e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:58.825060 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2d2c076c-bfdb-4db1-9671-f704e9809e4e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:58.825060 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2d2c076c-bfdb-4db1-9671-f704e9809e4e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:58.884817 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f4bc5b69-f7c5-4a61-9cae-85ea04231ca0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:58.885762 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2d2c076c-bfdb-4db1-9671-f704e9809e4e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:58.893449 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f4bc5b69-f7c5-4a61-9cae-85ea04231ca0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.164044 Apr 05 11:17:58.894339 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 322/658] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:58 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:58.902980 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2d2c076c-bfdb-4db1-9671-f704e9809e4e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1186 microversion: 2.1 time: 0.084015 Apr 05 11:17:58.902980 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 337/659] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:58 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:58.979511 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3ed5aacd-4c7d-4eb3-87c7-2b2fd1fc4e30 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:58.980262 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3ed5aacd-4c7d-4eb3-87c7-2b2fd1fc4e30 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:58.986144 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3ed5aacd-4c7d-4eb3-87c7-2b2fd1fc4e30 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:58.986620 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3ed5aacd-4c7d-4eb3-87c7-2b2fd1fc4e30 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:58.987402 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3ed5aacd-4c7d-4eb3-87c7-2b2fd1fc4e30 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:58.987881 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3ed5aacd-4c7d-4eb3-87c7-2b2fd1fc4e30 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:59.007176 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d7f356de-ab44-4f36-9ab5-1f34b5838edc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:59.008035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d7f356de-ab44-4f36-9ab5-1f34b5838edc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:59.014300 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d7f356de-ab44-4f36-9ab5-1f34b5838edc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:59.014885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d7f356de-ab44-4f36-9ab5-1f34b5838edc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:59.015856 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d7f356de-ab44-4f36-9ab5-1f34b5838edc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:59.016992 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d7f356de-ab44-4f36-9ab5-1f34b5838edc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:59.051670 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3ed5aacd-4c7d-4eb3-87c7-2b2fd1fc4e30 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:59.062775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3ed5aacd-4c7d-4eb3-87c7-2b2fd1fc4e30 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1223 microversion: 2.1 time: 0.087021 Apr 05 11:17:59.063396 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 338/660] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:58 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:17:59.137556 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5388bf6f-9444-47c3-8246-d1222107b8e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:59.138196 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5388bf6f-9444-47c3-8246-d1222107b8e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:59.144997 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5388bf6f-9444-47c3-8246-d1222107b8e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:59.145615 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5388bf6f-9444-47c3-8246-d1222107b8e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:59.147144 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5388bf6f-9444-47c3-8246-d1222107b8e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:59.147656 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5388bf6f-9444-47c3-8246-d1222107b8e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:59.154269 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d7f356de-ab44-4f36-9ab5-1f34b5838edc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:59.162742 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d7f356de-ab44-4f36-9ab5-1f34b5838edc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:59.168938 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d7f356de-ab44-4f36-9ab5-1f34b5838edc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:59.168938 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d7f356de-ab44-4f36-9ab5-1f34b5838edc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.162241 Apr 05 11:17:59.168938 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 323/661] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:17:59 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:17:59.286480 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5388bf6f-9444-47c3-8246-d1222107b8e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:59.293894 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5388bf6f-9444-47c3-8246-d1222107b8e0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.160421 Apr 05 11:17:59.294462 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 339/662] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:59 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:17:59.911268 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5b1d4eec-d9ab-42ec-a670-c2a284caea59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:59.911871 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9c161f70-c543-42f8-a824-cd6f5652d9ca tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:17:59.911871 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9c161f70-c543-42f8-a824-cd6f5652d9ca tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:59.912292 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5b1d4eec-d9ab-42ec-a670-c2a284caea59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:17:59.918000 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5b1d4eec-d9ab-42ec-a670-c2a284caea59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:59.918251 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9c161f70-c543-42f8-a824-cd6f5652d9ca tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:59.918694 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5b1d4eec-d9ab-42ec-a670-c2a284caea59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:59.918822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9c161f70-c543-42f8-a824-cd6f5652d9ca tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:59.930008 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5b1d4eec-d9ab-42ec-a670-c2a284caea59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:59.930170 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9c161f70-c543-42f8-a824-cd6f5652d9ca tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:17:59.930310 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5b1d4eec-d9ab-42ec-a670-c2a284caea59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:59.930533 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9c161f70-c543-42f8-a824-cd6f5652d9ca tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:17:59.981103 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9c161f70-c543-42f8-a824-cd6f5652d9ca tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:17:59.990091 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9c161f70-c543-42f8-a824-cd6f5652d9ca tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1186 microversion: 2.1 time: 0.083177 Apr 05 11:17:59.999828 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 340/663] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:59 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:00.079583 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-46a7971a-39c1-4f78-b0d5-31ca553fd233 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:00.080329 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5b1d4eec-d9ab-42ec-a670-c2a284caea59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:00.080467 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-46a7971a-39c1-4f78-b0d5-31ca553fd233 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:00.087140 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-46a7971a-39c1-4f78-b0d5-31ca553fd233 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:00.087593 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-46a7971a-39c1-4f78-b0d5-31ca553fd233 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:00.088157 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5b1d4eec-d9ab-42ec-a670-c2a284caea59 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.181269 Apr 05 11:18:00.088373 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-46a7971a-39c1-4f78-b0d5-31ca553fd233 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:00.088810 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-46a7971a-39c1-4f78-b0d5-31ca553fd233 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:00.098826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 324/664] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:17:59 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:00.158408 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-46a7971a-39c1-4f78-b0d5-31ca553fd233 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:00.184677 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-46a7971a-39c1-4f78-b0d5-31ca553fd233 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1223 microversion: 2.1 time: 0.099574 Apr 05 11:18:00.184677 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 341/665] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:00 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:00.184879 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-40d3409a-38ff-4b7c-9728-d7442691c403 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:00.185484 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-40d3409a-38ff-4b7c-9728-d7442691c403 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:00.192608 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-40d3409a-38ff-4b7c-9728-d7442691c403 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:00.193053 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-40d3409a-38ff-4b7c-9728-d7442691c403 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:00.193831 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-40d3409a-38ff-4b7c-9728-d7442691c403 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:00.194264 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-40d3409a-38ff-4b7c-9728-d7442691c403 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:00.311610 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1c19de77-ff12-424c-bba3-f3362c8d9cb1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:00.312217 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1c19de77-ff12-424c-bba3-f3362c8d9cb1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:00.321107 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1c19de77-ff12-424c-bba3-f3362c8d9cb1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:00.323696 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1c19de77-ff12-424c-bba3-f3362c8d9cb1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:00.323696 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1c19de77-ff12-424c-bba3-f3362c8d9cb1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:00.323696 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1c19de77-ff12-424c-bba3-f3362c8d9cb1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:00.532701 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-40d3409a-38ff-4b7c-9728-d7442691c403 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:00.542531 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-40d3409a-38ff-4b7c-9728-d7442691c403 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:00.544694 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-40d3409a-38ff-4b7c-9728-d7442691c403 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:00.546373 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-40d3409a-38ff-4b7c-9728-d7442691c403 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.366789 Apr 05 11:18:00.547230 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 325/666] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:00 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:00.600363 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1c19de77-ff12-424c-bba3-f3362c8d9cb1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:00.610198 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1c19de77-ff12-424c-bba3-f3362c8d9cb1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.302341 Apr 05 11:18:00.611210 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 342/667] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:00 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:01.007558 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a392a4c3-7d86-4dc2-a70e-0b3c94cb76b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:01.008089 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a392a4c3-7d86-4dc2-a70e-0b3c94cb76b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:01.014884 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a392a4c3-7d86-4dc2-a70e-0b3c94cb76b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:01.030550 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a392a4c3-7d86-4dc2-a70e-0b3c94cb76b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:01.030550 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a392a4c3-7d86-4dc2-a70e-0b3c94cb76b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:01.030550 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a392a4c3-7d86-4dc2-a70e-0b3c94cb76b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:01.085478 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a392a4c3-7d86-4dc2-a70e-0b3c94cb76b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:01.094041 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a392a4c3-7d86-4dc2-a70e-0b3c94cb76b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1204 microversion: 2.1 time: 0.090521 Apr 05 11:18:01.094994 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 326/668] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:01 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1204 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:01.106921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-942174a3-b32c-48a6-9fe4-0d5a84d8c08d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:01.107610 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-942174a3-b32c-48a6-9fe4-0d5a84d8c08d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:01.114928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-942174a3-b32c-48a6-9fe4-0d5a84d8c08d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:01.115459 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-942174a3-b32c-48a6-9fe4-0d5a84d8c08d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:01.116297 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-942174a3-b32c-48a6-9fe4-0d5a84d8c08d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:01.116808 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-942174a3-b32c-48a6-9fe4-0d5a84d8c08d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:01.192723 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2175e404-a6dd-4dc5-83da-646758215bcf tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:01.195279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2175e404-a6dd-4dc5-83da-646758215bcf tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:01.201819 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2175e404-a6dd-4dc5-83da-646758215bcf tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:01.202557 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2175e404-a6dd-4dc5-83da-646758215bcf tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:01.208510 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2175e404-a6dd-4dc5-83da-646758215bcf tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:01.208510 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2175e404-a6dd-4dc5-83da-646758215bcf tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:01.270551 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-942174a3-b32c-48a6-9fe4-0d5a84d8c08d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:01.275907 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2175e404-a6dd-4dc5-83da-646758215bcf tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:01.278101 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-942174a3-b32c-48a6-9fe4-0d5a84d8c08d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.175624 Apr 05 11:18:01.295654 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 343/669] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:01 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:01.296468 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2175e404-a6dd-4dc5-83da-646758215bcf tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1271 microversion: 2.1 time: 0.095691 Apr 05 11:18:01.296468 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 327/670] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:01 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:01.565838 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-61d22851-97fe-46cc-95a3-34b46b3b3c9b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:01.566460 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-61d22851-97fe-46cc-95a3-34b46b3b3c9b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:01.572451 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61d22851-97fe-46cc-95a3-34b46b3b3c9b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:01.572967 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61d22851-97fe-46cc-95a3-34b46b3b3c9b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:01.573749 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61d22851-97fe-46cc-95a3-34b46b3b3c9b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:01.574359 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61d22851-97fe-46cc-95a3-34b46b3b3c9b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:01.628162 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4d8179da-2307-45e0-824e-39e10417197e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:01.628781 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4d8179da-2307-45e0-824e-39e10417197e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:01.634837 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d8179da-2307-45e0-824e-39e10417197e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:01.635517 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d8179da-2307-45e0-824e-39e10417197e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:01.636288 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d8179da-2307-45e0-824e-39e10417197e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:01.636722 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d8179da-2307-45e0-824e-39e10417197e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:01.712979 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-61d22851-97fe-46cc-95a3-34b46b3b3c9b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:01.721271 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-61d22851-97fe-46cc-95a3-34b46b3b3c9b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:01.722895 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-61d22851-97fe-46cc-95a3-34b46b3b3c9b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:01.724336 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-61d22851-97fe-46cc-95a3-34b46b3b3c9b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.163042 Apr 05 11:18:01.724999 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 344/671] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:01 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:01.777609 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4d8179da-2307-45e0-824e-39e10417197e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:01.784748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4d8179da-2307-45e0-824e-39e10417197e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.161155 Apr 05 11:18:01.786910 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 328/672] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:01 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:02.111921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-27941fff-a6b3-4c51-961e-5c31ce3535f6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:02.112559 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-27941fff-a6b3-4c51-961e-5c31ce3535f6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:02.119341 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-27941fff-a6b3-4c51-961e-5c31ce3535f6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:02.124942 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-27941fff-a6b3-4c51-961e-5c31ce3535f6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:02.124942 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-27941fff-a6b3-4c51-961e-5c31ce3535f6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:02.124942 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-27941fff-a6b3-4c51-961e-5c31ce3535f6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:02.258970 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-27941fff-a6b3-4c51-961e-5c31ce3535f6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:02.266313 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-27941fff-a6b3-4c51-961e-5c31ce3535f6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1272 microversion: 2.1 time: 0.158800 Apr 05 11:18:02.266904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 345/673] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:02 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:02.295142 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6724809e-c504-4a6a-8677-700c7c3c7ce3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:02.295756 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6724809e-c504-4a6a-8677-700c7c3c7ce3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:02.303750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6724809e-c504-4a6a-8677-700c7c3c7ce3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:02.303750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6724809e-c504-4a6a-8677-700c7c3c7ce3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:02.304369 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6724809e-c504-4a6a-8677-700c7c3c7ce3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:02.304493 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-034b4e8e-82f8-49e3-8b7b-466c4b3d7b63 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:02.304616 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6724809e-c504-4a6a-8677-700c7c3c7ce3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:02.304967 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-034b4e8e-82f8-49e3-8b7b-466c4b3d7b63 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:02.310952 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-034b4e8e-82f8-49e3-8b7b-466c4b3d7b63 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:02.311398 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-034b4e8e-82f8-49e3-8b7b-466c4b3d7b63 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:02.312163 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-034b4e8e-82f8-49e3-8b7b-466c4b3d7b63 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:02.312592 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-034b4e8e-82f8-49e3-8b7b-466c4b3d7b63 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:02.371547 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-034b4e8e-82f8-49e3-8b7b-466c4b3d7b63 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:02.378836 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-034b4e8e-82f8-49e3-8b7b-466c4b3d7b63 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1271 microversion: 2.1 time: 0.078233 Apr 05 11:18:02.379410 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 346/674] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:02 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1271 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:02.441014 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6724809e-c504-4a6a-8677-700c7c3c7ce3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:02.448374 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6724809e-c504-4a6a-8677-700c7c3c7ce3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.157036 Apr 05 11:18:02.448939 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 329/675] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:02 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:02.742670 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7f1a0be1-77d6-4d9a-ad80-43a8ec4ab278 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:02.743372 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7f1a0be1-77d6-4d9a-ad80-43a8ec4ab278 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:02.749682 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f1a0be1-77d6-4d9a-ad80-43a8ec4ab278 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:02.750135 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f1a0be1-77d6-4d9a-ad80-43a8ec4ab278 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:02.750937 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f1a0be1-77d6-4d9a-ad80-43a8ec4ab278 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:02.751368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f1a0be1-77d6-4d9a-ad80-43a8ec4ab278 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:02.801956 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5dea73eb-00b8-4f75-86f7-3d2aa1a6de06 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:02.802568 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5dea73eb-00b8-4f75-86f7-3d2aa1a6de06 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:02.808559 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5dea73eb-00b8-4f75-86f7-3d2aa1a6de06 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:02.809010 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5dea73eb-00b8-4f75-86f7-3d2aa1a6de06 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:02.809810 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5dea73eb-00b8-4f75-86f7-3d2aa1a6de06 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:02.810324 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5dea73eb-00b8-4f75-86f7-3d2aa1a6de06 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:02.886267 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7f1a0be1-77d6-4d9a-ad80-43a8ec4ab278 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:02.894725 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7f1a0be1-77d6-4d9a-ad80-43a8ec4ab278 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:02.896264 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7f1a0be1-77d6-4d9a-ad80-43a8ec4ab278 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:02.897477 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7f1a0be1-77d6-4d9a-ad80-43a8ec4ab278 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.158657 Apr 05 11:18:02.898245 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 347/676] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:02 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:02.958087 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-c433de99-379c-4bb5-b24c-c8fde82a12f6 req-7c945eb6-b44e-45be-ab8f-5a234ff9099b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7680ed-da15-498a-a57d-a37e492ada5b", "name": "network-vif-plugged", "status": "completed", "tag": "141f21be-2523-4672-a366-4a146e7780e9"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:18:02.958328 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5dea73eb-00b8-4f75-86f7-3d2aa1a6de06 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:02.965326 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5dea73eb-00b8-4f75-86f7-3d2aa1a6de06 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.167391 Apr 05 11:18:02.966998 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c433de99-379c-4bb5-b24c-c8fde82a12f6 req-7c945eb6-b44e-45be-ab8f-5a234ff9099b service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:02.967581 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c433de99-379c-4bb5-b24c-c8fde82a12f6 req-7c945eb6-b44e-45be-ab8f-5a234ff9099b service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:02.975010 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 330/677] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:02 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:02.982626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-c433de99-379c-4bb5-b24c-c8fde82a12f6 req-7c945eb6-b44e-45be-ab8f-5a234ff9099b service nova] Creating event network-vif-plugged:141f21be-2523-4672-a366-4a146e7780e9 for instance 0d7680ed-da15-498a-a57d-a37e492ada5b on hv-cinder-81899 Apr 05 11:18:02.987719 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-c433de99-379c-4bb5-b24c-c8fde82a12f6 req-7c945eb6-b44e-45be-ab8f-5a234ff9099b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034735 Apr 05 11:18:02.988429 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 348/678] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:18:03.284424 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c321f5a9-5755-460d-95c7-2157e0653dd7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:03.285148 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c321f5a9-5755-460d-95c7-2157e0653dd7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:03.291361 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c321f5a9-5755-460d-95c7-2157e0653dd7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:03.291506 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c321f5a9-5755-460d-95c7-2157e0653dd7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:03.292303 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c321f5a9-5755-460d-95c7-2157e0653dd7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:03.292735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c321f5a9-5755-460d-95c7-2157e0653dd7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:03.396869 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-482d3ee2-25e1-4ebd-947d-de46d7b2e754 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:03.398006 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-482d3ee2-25e1-4ebd-947d-de46d7b2e754 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:03.404558 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-482d3ee2-25e1-4ebd-947d-de46d7b2e754 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:03.405062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-482d3ee2-25e1-4ebd-947d-de46d7b2e754 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:03.405902 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-482d3ee2-25e1-4ebd-947d-de46d7b2e754 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:03.406339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-482d3ee2-25e1-4ebd-947d-de46d7b2e754 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:03.426980 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c321f5a9-5755-460d-95c7-2157e0653dd7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:03.434312 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c321f5a9-5755-460d-95c7-2157e0653dd7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1272 microversion: 2.1 time: 0.154192 Apr 05 11:18:03.434919 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 331/679] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:03 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:03.465311 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b309fefc-416c-4b69-9ef0-8ab0c9bc1ef1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:03.465945 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b309fefc-416c-4b69-9ef0-8ab0c9bc1ef1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:03.471064 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-482d3ee2-25e1-4ebd-947d-de46d7b2e754 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:03.472543 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b309fefc-416c-4b69-9ef0-8ab0c9bc1ef1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:03.472995 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b309fefc-416c-4b69-9ef0-8ab0c9bc1ef1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:03.473756 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b309fefc-416c-4b69-9ef0-8ab0c9bc1ef1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:03.474189 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b309fefc-416c-4b69-9ef0-8ab0c9bc1ef1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:03.478408 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-482d3ee2-25e1-4ebd-947d-de46d7b2e754 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1271 microversion: 2.1 time: 0.086764 Apr 05 11:18:03.479087 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 349/680] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:03 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:03.607842 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b309fefc-416c-4b69-9ef0-8ab0c9bc1ef1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:03.615083 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b309fefc-416c-4b69-9ef0-8ab0c9bc1ef1 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.153772 Apr 05 11:18:03.615658 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 332/681] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:03 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:03.916093 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6d81c042-7df3-44cd-9642-076e35ef72bf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:03.916719 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6d81c042-7df3-44cd-9642-076e35ef72bf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:03.922570 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d81c042-7df3-44cd-9642-076e35ef72bf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:03.923039 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d81c042-7df3-44cd-9642-076e35ef72bf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:03.923793 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d81c042-7df3-44cd-9642-076e35ef72bf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:03.924225 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d81c042-7df3-44cd-9642-076e35ef72bf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:03.982299 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b8214730-b164-4098-814e-b9e2b6e0b2f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:03.984313 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b8214730-b164-4098-814e-b9e2b6e0b2f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:03.989074 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8214730-b164-4098-814e-b9e2b6e0b2f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:03.989522 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8214730-b164-4098-814e-b9e2b6e0b2f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:03.990466 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8214730-b164-4098-814e-b9e2b6e0b2f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:03.990965 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8214730-b164-4098-814e-b9e2b6e0b2f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:04.060404 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6d81c042-7df3-44cd-9642-076e35ef72bf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:04.068884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6d81c042-7df3-44cd-9642-076e35ef72bf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:04.070382 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6d81c042-7df3-44cd-9642-076e35ef72bf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:04.071563 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6d81c042-7df3-44cd-9642-076e35ef72bf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.159376 Apr 05 11:18:04.072148 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 350/682] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:03 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:04.121793 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b8214730-b164-4098-814e-b9e2b6e0b2f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:04.130021 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b8214730-b164-4098-814e-b9e2b6e0b2f6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.151625 Apr 05 11:18:04.130633 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 333/683] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:03 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:04.451038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-de920c8e-0470-4922-9b30-d8ba20027d13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:04.451640 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-de920c8e-0470-4922-9b30-d8ba20027d13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:04.462098 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de920c8e-0470-4922-9b30-d8ba20027d13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:04.462098 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de920c8e-0470-4922-9b30-d8ba20027d13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:04.462098 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de920c8e-0470-4922-9b30-d8ba20027d13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:04.462098 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de920c8e-0470-4922-9b30-d8ba20027d13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:04.495294 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dafca2f9-5ed0-4bd9-a87b-4e5c3675b898 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:04.496001 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dafca2f9-5ed0-4bd9-a87b-4e5c3675b898 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:04.502550 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dafca2f9-5ed0-4bd9-a87b-4e5c3675b898 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:04.503036 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dafca2f9-5ed0-4bd9-a87b-4e5c3675b898 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:04.503805 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dafca2f9-5ed0-4bd9-a87b-4e5c3675b898 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:04.504234 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dafca2f9-5ed0-4bd9-a87b-4e5c3675b898 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:04.565857 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dafca2f9-5ed0-4bd9-a87b-4e5c3675b898 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:04.573223 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dafca2f9-5ed0-4bd9-a87b-4e5c3675b898 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1271 microversion: 2.1 time: 0.081973 Apr 05 11:18:04.573790 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 334/684] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:04 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:04.596192 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-de920c8e-0470-4922-9b30-d8ba20027d13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:04.603598 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-de920c8e-0470-4922-9b30-d8ba20027d13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1272 microversion: 2.1 time: 0.156433 Apr 05 11:18:04.604165 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 351/685] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:04 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:04.632529 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f25009b8-57b2-43e6-ae8e-db6fb5c3b958 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:04.633132 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f25009b8-57b2-43e6-ae8e-db6fb5c3b958 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:04.639037 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f25009b8-57b2-43e6-ae8e-db6fb5c3b958 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:04.639482 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f25009b8-57b2-43e6-ae8e-db6fb5c3b958 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:04.640275 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f25009b8-57b2-43e6-ae8e-db6fb5c3b958 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:04.640708 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f25009b8-57b2-43e6-ae8e-db6fb5c3b958 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:04.772813 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f25009b8-57b2-43e6-ae8e-db6fb5c3b958 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:04.780095 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f25009b8-57b2-43e6-ae8e-db6fb5c3b958 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.151407 Apr 05 11:18:04.780655 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 335/686] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:04 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:05.089538 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-86e1efcf-1de7-4aed-932b-6e6e34d83fbe tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:05.090157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-86e1efcf-1de7-4aed-932b-6e6e34d83fbe tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:05.096322 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86e1efcf-1de7-4aed-932b-6e6e34d83fbe tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:05.096769 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86e1efcf-1de7-4aed-932b-6e6e34d83fbe tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:05.097521 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86e1efcf-1de7-4aed-932b-6e6e34d83fbe tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:05.097949 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86e1efcf-1de7-4aed-932b-6e6e34d83fbe tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:05.146751 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-606c3336-44e9-4999-b28a-663873046b8a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:05.147357 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-606c3336-44e9-4999-b28a-663873046b8a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:05.153193 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-606c3336-44e9-4999-b28a-663873046b8a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:05.153639 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-606c3336-44e9-4999-b28a-663873046b8a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:05.154418 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-606c3336-44e9-4999-b28a-663873046b8a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:05.154853 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-606c3336-44e9-4999-b28a-663873046b8a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:05.231877 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-86e1efcf-1de7-4aed-932b-6e6e34d83fbe tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:05.240237 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-86e1efcf-1de7-4aed-932b-6e6e34d83fbe tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:05.241737 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-86e1efcf-1de7-4aed-932b-6e6e34d83fbe tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:05.242900 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-86e1efcf-1de7-4aed-932b-6e6e34d83fbe tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.157237 Apr 05 11:18:05.243453 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 352/687] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:05 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:05.286499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-606c3336-44e9-4999-b28a-663873046b8a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:05.293978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-606c3336-44e9-4999-b28a-663873046b8a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.151196 Apr 05 11:18:05.294550 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 336/688] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:05 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:05.589989 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5dbc5d17-0153-4624-a3fc-4121f778e2d0 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:05.590501 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5dbc5d17-0153-4624-a3fc-4121f778e2d0 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:05.596799 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5dbc5d17-0153-4624-a3fc-4121f778e2d0 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:05.597246 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5dbc5d17-0153-4624-a3fc-4121f778e2d0 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:05.598008 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5dbc5d17-0153-4624-a3fc-4121f778e2d0 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:05.598444 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5dbc5d17-0153-4624-a3fc-4121f778e2d0 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:05.619928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-94827b6a-add0-4426-8441-eee304b2f51c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:05.620534 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-94827b6a-add0-4426-8441-eee304b2f51c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:05.627316 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94827b6a-add0-4426-8441-eee304b2f51c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:05.627760 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94827b6a-add0-4426-8441-eee304b2f51c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:05.628554 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94827b6a-add0-4426-8441-eee304b2f51c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:05.629071 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94827b6a-add0-4426-8441-eee304b2f51c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:05.657380 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5dbc5d17-0153-4624-a3fc-4121f778e2d0 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:05.664680 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5dbc5d17-0153-4624-a3fc-4121f778e2d0 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1271 microversion: 2.1 time: 0.078567 Apr 05 11:18:05.665252 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 353/689] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:05 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1271 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:05.761208 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-94827b6a-add0-4426-8441-eee304b2f51c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:05.768340 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-94827b6a-add0-4426-8441-eee304b2f51c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1272 microversion: 2.1 time: 0.152436 Apr 05 11:18:05.768901 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 337/690] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:05 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1272 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:05.796590 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-49cdc63c-a585-4898-a4d9-2925a1720eec tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:05.797304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-49cdc63c-a585-4898-a4d9-2925a1720eec tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:05.803607 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-49cdc63c-a585-4898-a4d9-2925a1720eec tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:05.804051 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-49cdc63c-a585-4898-a4d9-2925a1720eec tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:05.804802 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-49cdc63c-a585-4898-a4d9-2925a1720eec tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:05.805233 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-49cdc63c-a585-4898-a4d9-2925a1720eec tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:05.936868 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-49cdc63c-a585-4898-a4d9-2925a1720eec tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:05.944657 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-49cdc63c-a585-4898-a4d9-2925a1720eec tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.151956 Apr 05 11:18:05.945218 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 354/691] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:05 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:06.261074 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-506be167-955e-43b4-a269-8505de1350ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:06.261682 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-506be167-955e-43b4-a269-8505de1350ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:06.267669 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-506be167-955e-43b4-a269-8505de1350ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:06.268117 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-506be167-955e-43b4-a269-8505de1350ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:06.268878 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-506be167-955e-43b4-a269-8505de1350ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:06.269391 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-506be167-955e-43b4-a269-8505de1350ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:06.311402 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b092783d-6472-4777-ac34-fcfa41e8a98b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:06.312017 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b092783d-6472-4777-ac34-fcfa41e8a98b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:06.318019 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b092783d-6472-4777-ac34-fcfa41e8a98b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:06.318472 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b092783d-6472-4777-ac34-fcfa41e8a98b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:06.319272 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b092783d-6472-4777-ac34-fcfa41e8a98b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:06.319708 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b092783d-6472-4777-ac34-fcfa41e8a98b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:06.407274 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-506be167-955e-43b4-a269-8505de1350ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:06.416163 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-506be167-955e-43b4-a269-8505de1350ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:06.418110 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-506be167-955e-43b4-a269-8505de1350ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:06.419385 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-506be167-955e-43b4-a269-8505de1350ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.162337 Apr 05 11:18:06.420071 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 338/692] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:06 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:06.455622 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b092783d-6472-4777-ac34-fcfa41e8a98b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:06.463327 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b092783d-6472-4777-ac34-fcfa41e8a98b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.155801 Apr 05 11:18:06.463829 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 355/693] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:06 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:06.681820 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d5d2d5a9-a378-4632-810c-c649b8f3ebb2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:06.682428 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d5d2d5a9-a378-4632-810c-c649b8f3ebb2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:06.688818 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5d2d5a9-a378-4632-810c-c649b8f3ebb2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:06.689263 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5d2d5a9-a378-4632-810c-c649b8f3ebb2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:06.690022 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5d2d5a9-a378-4632-810c-c649b8f3ebb2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:06.690454 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5d2d5a9-a378-4632-810c-c649b8f3ebb2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:06.749487 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d5d2d5a9-a378-4632-810c-c649b8f3ebb2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:06.757070 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d5d2d5a9-a378-4632-810c-c649b8f3ebb2 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1271 microversion: 2.1 time: 0.079326 Apr 05 11:18:06.757624 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 339/694] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:06 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1271 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:06.785245 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6f9e4dea-3a05-448e-a936-ebba7a2398d1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:06.785857 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6f9e4dea-3a05-448e-a936-ebba7a2398d1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:06.792206 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6f9e4dea-3a05-448e-a936-ebba7a2398d1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:06.792659 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6f9e4dea-3a05-448e-a936-ebba7a2398d1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:06.793510 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6f9e4dea-3a05-448e-a936-ebba7a2398d1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:06.793944 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6f9e4dea-3a05-448e-a936-ebba7a2398d1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:06.930425 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6f9e4dea-3a05-448e-a936-ebba7a2398d1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:06.937896 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6f9e4dea-3a05-448e-a936-ebba7a2398d1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1272 microversion: 2.1 time: 0.157140 Apr 05 11:18:06.938583 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 356/695] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:06 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:06.961028 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-00935d3e-7cc7-4ff6-b8dc-7de0a2afb1a2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:06.961631 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-00935d3e-7cc7-4ff6-b8dc-7de0a2afb1a2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:06.967417 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00935d3e-7cc7-4ff6-b8dc-7de0a2afb1a2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:06.967857 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00935d3e-7cc7-4ff6-b8dc-7de0a2afb1a2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:06.968607 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00935d3e-7cc7-4ff6-b8dc-7de0a2afb1a2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:06.969036 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00935d3e-7cc7-4ff6-b8dc-7de0a2afb1a2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:07.100193 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-00935d3e-7cc7-4ff6-b8dc-7de0a2afb1a2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:07.107587 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-00935d3e-7cc7-4ff6-b8dc-7de0a2afb1a2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.150310 Apr 05 11:18:07.108151 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 340/696] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:06 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:07.437387 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9a02bc7e-2748-4f80-ae1b-9922ed687800 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:07.437908 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9a02bc7e-2748-4f80-ae1b-9922ed687800 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:07.444254 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a02bc7e-2748-4f80-ae1b-9922ed687800 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:07.444708 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a02bc7e-2748-4f80-ae1b-9922ed687800 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:07.445471 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a02bc7e-2748-4f80-ae1b-9922ed687800 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:07.445906 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a02bc7e-2748-4f80-ae1b-9922ed687800 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:07.480521 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8172c3fc-0cac-4924-811e-3e7af8aca033 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:07.481209 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8172c3fc-0cac-4924-811e-3e7af8aca033 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:07.487375 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8172c3fc-0cac-4924-811e-3e7af8aca033 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:07.487824 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8172c3fc-0cac-4924-811e-3e7af8aca033 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:07.488612 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8172c3fc-0cac-4924-811e-3e7af8aca033 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:07.489072 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8172c3fc-0cac-4924-811e-3e7af8aca033 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:07.582013 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9a02bc7e-2748-4f80-ae1b-9922ed687800 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:07.591170 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9a02bc7e-2748-4f80-ae1b-9922ed687800 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:07.592670 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9a02bc7e-2748-4f80-ae1b-9922ed687800 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:07.593833 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9a02bc7e-2748-4f80-ae1b-9922ed687800 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.160437 Apr 05 11:18:07.594388 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 357/697] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:07 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:07.623139 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8172c3fc-0cac-4924-811e-3e7af8aca033 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:07.630998 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8172c3fc-0cac-4924-811e-3e7af8aca033 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.154183 Apr 05 11:18:07.631599 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 341/698] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:07 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:07.773354 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fcd07efd-d775-4054-890b-ed8e0f45a2e3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:07.773972 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fcd07efd-d775-4054-890b-ed8e0f45a2e3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:07.779990 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fcd07efd-d775-4054-890b-ed8e0f45a2e3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:07.784375 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fcd07efd-d775-4054-890b-ed8e0f45a2e3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:07.784375 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fcd07efd-d775-4054-890b-ed8e0f45a2e3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:07.784375 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fcd07efd-d775-4054-890b-ed8e0f45a2e3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:07.843821 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fcd07efd-d775-4054-890b-ed8e0f45a2e3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:07.851960 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fcd07efd-d775-4054-890b-ed8e0f45a2e3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1271 microversion: 2.1 time: 0.082511 Apr 05 11:18:07.853007 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 358/699] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:07 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:07.954480 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c31bd023-27ce-4e1b-92b6-82e138a9907d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:07.955069 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c31bd023-27ce-4e1b-92b6-82e138a9907d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:07.961745 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c31bd023-27ce-4e1b-92b6-82e138a9907d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:07.962188 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c31bd023-27ce-4e1b-92b6-82e138a9907d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:07.962980 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c31bd023-27ce-4e1b-92b6-82e138a9907d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:07.963468 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c31bd023-27ce-4e1b-92b6-82e138a9907d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:08.125492 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e340c6cf-7ba6-4c5c-a0d2-05da9a2a7f5a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:08.126094 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e340c6cf-7ba6-4c5c-a0d2-05da9a2a7f5a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:08.126195 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c31bd023-27ce-4e1b-92b6-82e138a9907d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:08.133074 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e340c6cf-7ba6-4c5c-a0d2-05da9a2a7f5a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:08.133608 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e340c6cf-7ba6-4c5c-a0d2-05da9a2a7f5a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:08.134204 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c31bd023-27ce-4e1b-92b6-82e138a9907d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1272 microversion: 2.1 time: 0.183619 Apr 05 11:18:08.134418 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e340c6cf-7ba6-4c5c-a0d2-05da9a2a7f5a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:08.134802 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 342/700] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:07 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:08.134949 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e340c6cf-7ba6-4c5c-a0d2-05da9a2a7f5a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:08.293461 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e340c6cf-7ba6-4c5c-a0d2-05da9a2a7f5a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:08.305081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e340c6cf-7ba6-4c5c-a0d2-05da9a2a7f5a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.183496 Apr 05 11:18:08.305916 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 359/701] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:08 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:08.611784 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8ac6f1fd-364d-4109-ae19-5ab545cafcd2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:08.612398 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8ac6f1fd-364d-4109-ae19-5ab545cafcd2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:08.619204 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8ac6f1fd-364d-4109-ae19-5ab545cafcd2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:08.619657 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8ac6f1fd-364d-4109-ae19-5ab545cafcd2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:08.620445 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8ac6f1fd-364d-4109-ae19-5ab545cafcd2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:08.625015 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8ac6f1fd-364d-4109-ae19-5ab545cafcd2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:08.647970 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-93545880-820e-408a-aeca-1b8f8df2f784 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:08.648782 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-93545880-820e-408a-aeca-1b8f8df2f784 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:08.655157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93545880-820e-408a-aeca-1b8f8df2f784 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:08.655693 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93545880-820e-408a-aeca-1b8f8df2f784 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:08.656541 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93545880-820e-408a-aeca-1b8f8df2f784 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:08.657069 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93545880-820e-408a-aeca-1b8f8df2f784 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:08.800694 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-93545880-820e-408a-aeca-1b8f8df2f784 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:08.810994 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-93545880-820e-408a-aeca-1b8f8df2f784 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.167647 Apr 05 11:18:08.815625 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 360/702] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:08 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:08.816555 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-341ce163-0717-49c3-9bad-f79bb2672478 req-7e64eed9-3229-4746-9a60-cfe110f7544b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4e16432-3df3-4325-b757-906fbbeca604", "tag": "dc377578-0184-4a80-88e0-2385eab5c0c4"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:18:08.825436 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-341ce163-0717-49c3-9bad-f79bb2672478 req-7e64eed9-3229-4746-9a60-cfe110f7544b service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:08.825813 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-341ce163-0717-49c3-9bad-f79bb2672478 req-7e64eed9-3229-4746-9a60-cfe110f7544b service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:08.839099 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-341ce163-0717-49c3-9bad-f79bb2672478 req-7e64eed9-3229-4746-9a60-cfe110f7544b service nova] Creating event network-changed:dc377578-0184-4a80-88e0-2385eab5c0c4 for instance e4e16432-3df3-4325-b757-906fbbeca604 on hv-cinder-81899 Apr 05 11:18:08.844093 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-341ce163-0717-49c3-9bad-f79bb2672478 req-7e64eed9-3229-4746-9a60-cfe110f7544b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031181 Apr 05 11:18:08.844837 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 361/703] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:18:08.870799 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4b6da668-6634-4c99-8c54-36bb287becdd tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:08.871539 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4b6da668-6634-4c99-8c54-36bb287becdd tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:08.877970 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4b6da668-6634-4c99-8c54-36bb287becdd tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:08.878423 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4b6da668-6634-4c99-8c54-36bb287becdd tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:08.879240 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4b6da668-6634-4c99-8c54-36bb287becdd tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:08.879680 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4b6da668-6634-4c99-8c54-36bb287becdd tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:08.906211 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8ac6f1fd-364d-4109-ae19-5ab545cafcd2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:08.917248 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8ac6f1fd-364d-4109-ae19-5ab545cafcd2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:08.918795 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8ac6f1fd-364d-4109-ae19-5ab545cafcd2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:08.919963 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8ac6f1fd-364d-4109-ae19-5ab545cafcd2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1724 microversion: 2.20 time: 0.312258 Apr 05 11:18:08.920528 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 343/704] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:08 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1724 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:08.944335 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4b6da668-6634-4c99-8c54-36bb287becdd tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:08.951816 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4b6da668-6634-4c99-8c54-36bb287becdd tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1279 microversion: 2.1 time: 0.086978 Apr 05 11:18:08.952384 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 362/705] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:08 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:09.151761 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a1eb5d7a-9f0d-4614-b486-052cf73c0c6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:09.152512 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a1eb5d7a-9f0d-4614-b486-052cf73c0c6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:09.158936 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1eb5d7a-9f0d-4614-b486-052cf73c0c6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:09.159390 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1eb5d7a-9f0d-4614-b486-052cf73c0c6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:09.160162 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1eb5d7a-9f0d-4614-b486-052cf73c0c6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:09.160597 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1eb5d7a-9f0d-4614-b486-052cf73c0c6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:09.332077 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-785de351-0c25-4201-bf8b-563c60c0ec50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:09.332880 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-785de351-0c25-4201-bf8b-563c60c0ec50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:09.340628 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-785de351-0c25-4201-bf8b-563c60c0ec50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:09.342746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-785de351-0c25-4201-bf8b-563c60c0ec50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:09.342746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-785de351-0c25-4201-bf8b-563c60c0ec50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:09.342746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-785de351-0c25-4201-bf8b-563c60c0ec50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:09.364773 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a1eb5d7a-9f0d-4614-b486-052cf73c0c6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:09.373050 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a1eb5d7a-9f0d-4614-b486-052cf73c0c6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1272 microversion: 2.1 time: 0.225064 Apr 05 11:18:09.374388 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 344/706] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:09 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1272 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:09.678563 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-785de351-0c25-4201-bf8b-563c60c0ec50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:09.685951 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-785de351-0c25-4201-bf8b-563c60c0ec50 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.362986 Apr 05 11:18:09.686528 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 363/707] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:09 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:09.827935 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-64ae5759-a00d-4ed7-baf0-c3005fefa84e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:09.828543 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-64ae5759-a00d-4ed7-baf0-c3005fefa84e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:09.834514 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-64ae5759-a00d-4ed7-baf0-c3005fefa84e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:09.834999 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-64ae5759-a00d-4ed7-baf0-c3005fefa84e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:09.835812 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-64ae5759-a00d-4ed7-baf0-c3005fefa84e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:09.836250 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-64ae5759-a00d-4ed7-baf0-c3005fefa84e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:09.937968 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-08df7ca9-c794-4750-90e0-f07faced3a30 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:09.940610 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-08df7ca9-c794-4750-90e0-f07faced3a30 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:09.945017 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-08df7ca9-c794-4750-90e0-f07faced3a30 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:09.945469 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-08df7ca9-c794-4750-90e0-f07faced3a30 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:09.946242 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-08df7ca9-c794-4750-90e0-f07faced3a30 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:09.946705 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-08df7ca9-c794-4750-90e0-f07faced3a30 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:09.969572 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-64ae5759-a00d-4ed7-baf0-c3005fefa84e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:09.977613 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-64ae5759-a00d-4ed7-baf0-c3005fefa84e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1366 microversion: 2.1 time: 0.153594 Apr 05 11:18:09.978206 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 345/708] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:09 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:09.982688 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-36b3bcac-541a-45b0-871d-d0f7a17dcec5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:09.983300 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-36b3bcac-541a-45b0-871d-d0f7a17dcec5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:09.989372 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36b3bcac-541a-45b0-871d-d0f7a17dcec5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:09.989873 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36b3bcac-541a-45b0-871d-d0f7a17dcec5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:09.991289 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36b3bcac-541a-45b0-871d-d0f7a17dcec5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:09.991947 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36b3bcac-541a-45b0-871d-d0f7a17dcec5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:10.067674 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-36b3bcac-541a-45b0-871d-d0f7a17dcec5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:10.080980 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-36b3bcac-541a-45b0-871d-d0f7a17dcec5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1289 microversion: 2.1 time: 0.101491 Apr 05 11:18:10.091647 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 346/709] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:09 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:10.105219 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-08df7ca9-c794-4750-90e0-f07faced3a30 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:10.112544 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-08df7ca9-c794-4750-90e0-f07faced3a30 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:10.114261 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-08df7ca9-c794-4750-90e0-f07faced3a30 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:10.115568 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-08df7ca9-c794-4750-90e0-f07faced3a30 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1727 microversion: 2.20 time: 0.181482 Apr 05 11:18:10.116139 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 364/710] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:09 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:18:10.136703 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bbf8b14a-2042-4ace-a22a-278599af42b2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ae74597-915a-49ab-8e3c-ba081005a86d"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:18:10.137999 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bbf8b14a-2042-4ace-a22a-278599af42b2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:10.144504 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bbf8b14a-2042-4ace-a22a-278599af42b2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:10.144957 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bbf8b14a-2042-4ace-a22a-278599af42b2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:10.145749 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bbf8b14a-2042-4ace-a22a-278599af42b2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:10.146188 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bbf8b14a-2042-4ace-a22a-278599af42b2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:10.391191 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4f9db0cc-b589-4b90-a5f8-be02616bbb13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:10.391789 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4f9db0cc-b589-4b90-a5f8-be02616bbb13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:10.398261 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f9db0cc-b589-4b90-a5f8-be02616bbb13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:10.398755 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f9db0cc-b589-4b90-a5f8-be02616bbb13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:10.399546 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f9db0cc-b589-4b90-a5f8-be02616bbb13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:10.400010 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f9db0cc-b589-4b90-a5f8-be02616bbb13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:10.662673 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4f9db0cc-b589-4b90-a5f8-be02616bbb13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:10.670758 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4f9db0cc-b589-4b90-a5f8-be02616bbb13 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1272 microversion: 2.1 time: 0.283383 Apr 05 11:18:10.671336 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 365/711] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:10 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1272 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:10.704299 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2380aabe-2d58-46eb-9f9a-c2c4cae78a0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:10.705158 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2380aabe-2d58-46eb-9f9a-c2c4cae78a0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:10.713297 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2380aabe-2d58-46eb-9f9a-c2c4cae78a0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:10.713940 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2380aabe-2d58-46eb-9f9a-c2c4cae78a0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:10.714871 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2380aabe-2d58-46eb-9f9a-c2c4cae78a0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:10.715398 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2380aabe-2d58-46eb-9f9a-c2c4cae78a0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:10.916198 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2380aabe-2d58-46eb-9f9a-c2c4cae78a0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:10.923467 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2380aabe-2d58-46eb-9f9a-c2c4cae78a0d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.225409 Apr 05 11:18:10.924180 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 366/712] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:10 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:10.995300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-90e496be-6685-4cb0-9a7f-bfe7aa2449e2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:10.995938 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-90e496be-6685-4cb0-9a7f-bfe7aa2449e2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:11.003679 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90e496be-6685-4cb0-9a7f-bfe7aa2449e2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:11.004176 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90e496be-6685-4cb0-9a7f-bfe7aa2449e2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:11.004944 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90e496be-6685-4cb0-9a7f-bfe7aa2449e2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:11.005377 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90e496be-6685-4cb0-9a7f-bfe7aa2449e2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:11.211688 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-90e496be-6685-4cb0-9a7f-bfe7aa2449e2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:11.218978 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-90e496be-6685-4cb0-9a7f-bfe7aa2449e2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1556 microversion: 2.1 time: 0.228030 Apr 05 11:18:11.219541 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 367/713] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:10 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1556 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:11.224227 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0ab7e338-2b43-4b38-807c-a5a1d8e0dd0d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:11.225298 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0ab7e338-2b43-4b38-807c-a5a1d8e0dd0d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:11.231202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ab7e338-2b43-4b38-807c-a5a1d8e0dd0d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:11.231644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ab7e338-2b43-4b38-807c-a5a1d8e0dd0d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:11.232482 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ab7e338-2b43-4b38-807c-a5a1d8e0dd0d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:11.232918 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ab7e338-2b43-4b38-807c-a5a1d8e0dd0d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:11.403804 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0ab7e338-2b43-4b38-807c-a5a1d8e0dd0d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:11.411731 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0ab7e338-2b43-4b38-807c-a5a1d8e0dd0d tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1319 microversion: 2.1 time: 0.191208 Apr 05 11:18:11.412448 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 368/714] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:11 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:11.417459 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-97bdfcb1-bdaf-4fea-bd15-92923c00b160 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:11.418218 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-97bdfcb1-bdaf-4fea-bd15-92923c00b160 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:11.424262 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97bdfcb1-bdaf-4fea-bd15-92923c00b160 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:11.424893 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97bdfcb1-bdaf-4fea-bd15-92923c00b160 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:11.425748 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97bdfcb1-bdaf-4fea-bd15-92923c00b160 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:11.426374 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97bdfcb1-bdaf-4fea-bd15-92923c00b160 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:11.586321 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bbf8b14a-2042-4ace-a22a-278599af42b2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "POST /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.453744 Apr 05 11:18:11.587182 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 347/715] 10.222.0.39 () {62 vars in 1363 bytes} [Tue Apr 5 11:18:10 2022] POST /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-volume_attachments => generated 188 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:18:11.589955 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-97bdfcb1-bdaf-4fea-bd15-92923c00b160 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176313 Apr 05 11:18:11.590683 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 369/716] 10.222.0.39 () {58 vars in 1274 bytes} [Tue Apr 5 11:18:11 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:18:11.694570 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-42685571-5d87-476b-9fdc-f92a60a8ab55 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:11.695446 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-42685571-5d87-476b-9fdc-f92a60a8ab55 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:11.703697 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42685571-5d87-476b-9fdc-f92a60a8ab55 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:11.704449 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42685571-5d87-476b-9fdc-f92a60a8ab55 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:11.706354 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42685571-5d87-476b-9fdc-f92a60a8ab55 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:11.707559 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42685571-5d87-476b-9fdc-f92a60a8ab55 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:11.722405 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ff2c8bf2-2f48-4f2a-b046-9dbb290a8560 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:18:11.723332 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ff2c8bf2-2f48-4f2a-b046-9dbb290a8560 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:11.732474 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff2c8bf2-2f48-4f2a-b046-9dbb290a8560 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:11.733220 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff2c8bf2-2f48-4f2a-b046-9dbb290a8560 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:11.734709 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff2c8bf2-2f48-4f2a-b046-9dbb290a8560 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:11.735769 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff2c8bf2-2f48-4f2a-b046-9dbb290a8560 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:11.957802 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-42685571-5d87-476b-9fdc-f92a60a8ab55 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:11.967579 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-42685571-5d87-476b-9fdc-f92a60a8ab55 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.283026 Apr 05 11:18:11.968402 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 348/717] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:11 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:11.973077 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a221b30d-683c-4459-97b2-1c1d5f4495a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:11.973676 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a221b30d-683c-4459-97b2-1c1d5f4495a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:11.979589 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a221b30d-683c-4459-97b2-1c1d5f4495a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:11.980031 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a221b30d-683c-4459-97b2-1c1d5f4495a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:11.981090 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a221b30d-683c-4459-97b2-1c1d5f4495a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:11.981521 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a221b30d-683c-4459-97b2-1c1d5f4495a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:12.034270 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ff2c8bf2-2f48-4f2a-b046-9dbb290a8560 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "POST /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/action" status: 202 len: 0 microversion: 2.20 time: 0.318867 Apr 05 11:18:12.035557 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 370/718] 10.222.0.39 () {62 vars in 1318 bytes} [Tue Apr 5 11:18:11 2022] POST /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:18:12.045244 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f857159a-3e16-4727-bdec-7341b25d90e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:12.046588 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f857159a-3e16-4727-bdec-7341b25d90e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:12.064279 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f857159a-3e16-4727-bdec-7341b25d90e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:12.065624 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f857159a-3e16-4727-bdec-7341b25d90e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:12.066587 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f857159a-3e16-4727-bdec-7341b25d90e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:12.067299 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f857159a-3e16-4727-bdec-7341b25d90e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:12.260465 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f857159a-3e16-4727-bdec-7341b25d90e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:12.270072 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f857159a-3e16-4727-bdec-7341b25d90e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:12.272315 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f857159a-3e16-4727-bdec-7341b25d90e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:12.273506 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f857159a-3e16-4727-bdec-7341b25d90e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1753 microversion: 2.20 time: 0.232260 Apr 05 11:18:12.274335 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 371/719] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:12 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1753 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:12.277511 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a221b30d-683c-4459-97b2-1c1d5f4495a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:12.289245 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a221b30d-683c-4459-97b2-1c1d5f4495a6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1370 microversion: 2.1 time: 0.319605 Apr 05 11:18:12.299069 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 349/720] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:11 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1370 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:12.345239 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-e70739bf-0626-4ef7-af6a-ed45fec5c7b5 req-e7e1d55b-6e43-411a-b065-fba8d7ef9144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce13b8dc-7708-416a-b29b-d5cac40ad1a3", "tag": "103701da-a5c4-43b6-8514-24a0767fa475"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:18:12.355641 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-e70739bf-0626-4ef7-af6a-ed45fec5c7b5 req-e7e1d55b-6e43-411a-b065-fba8d7ef9144 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:12.355962 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-e70739bf-0626-4ef7-af6a-ed45fec5c7b5 req-e7e1d55b-6e43-411a-b065-fba8d7ef9144 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:12.376553 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-e70739bf-0626-4ef7-af6a-ed45fec5c7b5 req-e7e1d55b-6e43-411a-b065-fba8d7ef9144 service nova] Creating event network-changed:103701da-a5c4-43b6-8514-24a0767fa475 for instance ce13b8dc-7708-416a-b29b-d5cac40ad1a3 on hv-cinder-81899 Apr 05 11:18:12.381641 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-e70739bf-0626-4ef7-af6a-ed45fec5c7b5 req-e7e1d55b-6e43-411a-b065-fba8d7ef9144 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044875 Apr 05 11:18:12.382243 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 372/721] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:18:12.430148 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b1feaaf5-ee21-4ff1-8a37-337595b9a127 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:12.433423 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b1feaaf5-ee21-4ff1-8a37-337595b9a127 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:12.437871 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b1feaaf5-ee21-4ff1-8a37-337595b9a127 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:12.438860 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b1feaaf5-ee21-4ff1-8a37-337595b9a127 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:12.439752 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b1feaaf5-ee21-4ff1-8a37-337595b9a127 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:12.440191 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b1feaaf5-ee21-4ff1-8a37-337595b9a127 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:12.764328 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b1feaaf5-ee21-4ff1-8a37-337595b9a127 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:12.773616 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b1feaaf5-ee21-4ff1-8a37-337595b9a127 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1319 microversion: 2.1 time: 0.348298 Apr 05 11:18:12.774729 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 350/722] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:12 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:12.986386 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a3e96521-1d8e-4fef-a8f6-e3885086ef32 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:12.987187 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a3e96521-1d8e-4fef-a8f6-e3885086ef32 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:12.994743 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3e96521-1d8e-4fef-a8f6-e3885086ef32 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:12.995277 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3e96521-1d8e-4fef-a8f6-e3885086ef32 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:12.996130 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3e96521-1d8e-4fef-a8f6-e3885086ef32 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:12.997217 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3e96521-1d8e-4fef-a8f6-e3885086ef32 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:13.140963 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-92a463eb-45fc-4ee3-9178-522a64a391e7 req-ab44dd64-4663-46d0-a03e-60066b9f3cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83911c9a-66fa-4dc2-b353-e8367ed89f27", "tag": "41e4db55-0008-44c7-9892-ce0d8234ca56"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:18:13.151867 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-92a463eb-45fc-4ee3-9178-522a64a391e7 req-ab44dd64-4663-46d0-a03e-60066b9f3cb6 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:13.152037 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-92a463eb-45fc-4ee3-9178-522a64a391e7 req-ab44dd64-4663-46d0-a03e-60066b9f3cb6 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:13.174331 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-92a463eb-45fc-4ee3-9178-522a64a391e7 req-ab44dd64-4663-46d0-a03e-60066b9f3cb6 service nova] Creating event network-changed:41e4db55-0008-44c7-9892-ce0d8234ca56 for instance 83911c9a-66fa-4dc2-b353-e8367ed89f27 on hv-cinder-81899 Apr 05 11:18:13.180641 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-92a463eb-45fc-4ee3-9178-522a64a391e7 req-ab44dd64-4663-46d0-a03e-60066b9f3cb6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048326 Apr 05 11:18:13.181394 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 351/723] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:18:13.221498 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a3e96521-1d8e-4fef-a8f6-e3885086ef32 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:13.228882 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a3e96521-1d8e-4fef-a8f6-e3885086ef32 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.247442 Apr 05 11:18:13.229740 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 373/724] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:12 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:13.292607 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e71ea41f-cc04-4d7d-b339-247b5f6f2812 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:13.293373 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e71ea41f-cc04-4d7d-b339-247b5f6f2812 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:13.299596 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e71ea41f-cc04-4d7d-b339-247b5f6f2812 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:13.309778 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e1eabfbf-703c-49af-a2f6-4c4287424643 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:13.310991 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e1eabfbf-703c-49af-a2f6-4c4287424643 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:13.315487 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e71ea41f-cc04-4d7d-b339-247b5f6f2812 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:13.318959 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e71ea41f-cc04-4d7d-b339-247b5f6f2812 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:13.320745 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1eabfbf-703c-49af-a2f6-4c4287424643 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:13.321375 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e71ea41f-cc04-4d7d-b339-247b5f6f2812 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:13.326063 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1eabfbf-703c-49af-a2f6-4c4287424643 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:13.326990 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1eabfbf-703c-49af-a2f6-4c4287424643 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:13.327441 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1eabfbf-703c-49af-a2f6-4c4287424643 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:13.499926 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e1eabfbf-703c-49af-a2f6-4c4287424643 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:13.500633 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e71ea41f-cc04-4d7d-b339-247b5f6f2812 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:13.518059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e1eabfbf-703c-49af-a2f6-4c4287424643 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1563 microversion: 2.1 time: 0.204587 Apr 05 11:18:13.518059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 374/725] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:13 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1563 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:13.519750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e71ea41f-cc04-4d7d-b339-247b5f6f2812 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:13.521585 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e71ea41f-cc04-4d7d-b339-247b5f6f2812 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:13.523104 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e71ea41f-cc04-4d7d-b339-247b5f6f2812 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1753 microversion: 2.20 time: 0.234616 Apr 05 11:18:13.524134 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 352/726] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:13 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1753 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:13.528802 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7ec031ac-fae5-4dac-9b00-effcfdc3f8b4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:13.529377 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7ec031ac-fae5-4dac-9b00-effcfdc3f8b4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:13.536140 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7ec031ac-fae5-4dac-9b00-effcfdc3f8b4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:13.536588 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7ec031ac-fae5-4dac-9b00-effcfdc3f8b4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:13.537893 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7ec031ac-fae5-4dac-9b00-effcfdc3f8b4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:13.538358 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7ec031ac-fae5-4dac-9b00-effcfdc3f8b4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:13.631870 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7ec031ac-fae5-4dac-9b00-effcfdc3f8b4 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107557 Apr 05 11:18:13.640001 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 375/727] 10.222.0.39 () {58 vars in 1274 bytes} [Tue Apr 5 11:18:13 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:18:13.791296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3ea6c86e-0e2d-4a23-a99e-e78689da83c9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:13.791877 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3ea6c86e-0e2d-4a23-a99e-e78689da83c9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:13.798148 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3ea6c86e-0e2d-4a23-a99e-e78689da83c9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:13.798594 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3ea6c86e-0e2d-4a23-a99e-e78689da83c9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:13.799624 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3ea6c86e-0e2d-4a23-a99e-e78689da83c9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:13.800060 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3ea6c86e-0e2d-4a23-a99e-e78689da83c9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:13.950199 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3ea6c86e-0e2d-4a23-a99e-e78689da83c9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:13.958207 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3ea6c86e-0e2d-4a23-a99e-e78689da83c9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1319 microversion: 2.1 time: 0.170858 Apr 05 11:18:13.959343 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 353/728] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:13 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:14.247127 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-63150b47-b17a-48f1-8566-5378a4fe3a18 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:14.247737 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-63150b47-b17a-48f1-8566-5378a4fe3a18 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:14.254060 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-63150b47-b17a-48f1-8566-5378a4fe3a18 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:14.254511 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-63150b47-b17a-48f1-8566-5378a4fe3a18 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:14.255485 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-63150b47-b17a-48f1-8566-5378a4fe3a18 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:14.255946 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-63150b47-b17a-48f1-8566-5378a4fe3a18 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:14.525709 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-63150b47-b17a-48f1-8566-5378a4fe3a18 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:14.533172 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-63150b47-b17a-48f1-8566-5378a4fe3a18 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.290763 Apr 05 11:18:14.533738 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 376/729] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:14 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:14.541616 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9c6fb4b4-e601-4fd8-9a9f-10d3427e3b8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:14.542323 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9c6fb4b4-e601-4fd8-9a9f-10d3427e3b8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:14.548790 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c6fb4b4-e601-4fd8-9a9f-10d3427e3b8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:14.549176 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c6fb4b4-e601-4fd8-9a9f-10d3427e3b8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:14.549943 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c6fb4b4-e601-4fd8-9a9f-10d3427e3b8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:14.550372 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c6fb4b4-e601-4fd8-9a9f-10d3427e3b8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:14.724053 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9c6fb4b4-e601-4fd8-9a9f-10d3427e3b8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:14.732907 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9c6fb4b4-e601-4fd8-9a9f-10d3427e3b8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:14.734404 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9c6fb4b4-e601-4fd8-9a9f-10d3427e3b8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:14.735932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9c6fb4b4-e601-4fd8-9a9f-10d3427e3b8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1753 microversion: 2.20 time: 0.198639 Apr 05 11:18:14.737016 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 354/730] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:14 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1753 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:14.976237 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-33eccbac-a5b7-401d-ae82-3fc4b5a84b55 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:14.977081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-33eccbac-a5b7-401d-ae82-3fc4b5a84b55 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:14.983950 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33eccbac-a5b7-401d-ae82-3fc4b5a84b55 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:14.984686 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33eccbac-a5b7-401d-ae82-3fc4b5a84b55 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:14.985610 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33eccbac-a5b7-401d-ae82-3fc4b5a84b55 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:14.986192 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33eccbac-a5b7-401d-ae82-3fc4b5a84b55 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:15.027886 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-5781b2b8-a845-49f6-aca7-349a4ab0c274 req-6aba016c-0b02-4003-a90b-a403d1df60d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7680ed-da15-498a-a57d-a37e492ada5b", "tag": "141f21be-2523-4672-a366-4a146e7780e9"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:18:15.039965 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-5781b2b8-a845-49f6-aca7-349a4ab0c274 req-6aba016c-0b02-4003-a90b-a403d1df60d2 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:15.040685 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-5781b2b8-a845-49f6-aca7-349a4ab0c274 req-6aba016c-0b02-4003-a90b-a403d1df60d2 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:15.052304 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-5781b2b8-a845-49f6-aca7-349a4ab0c274 req-6aba016c-0b02-4003-a90b-a403d1df60d2 service nova] Creating event network-changed:141f21be-2523-4672-a366-4a146e7780e9 for instance 0d7680ed-da15-498a-a57d-a37e492ada5b on hv-cinder-81899 Apr 05 11:18:15.058787 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-5781b2b8-a845-49f6-aca7-349a4ab0c274 req-6aba016c-0b02-4003-a90b-a403d1df60d2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034803 Apr 05 11:18:15.059821 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 355/731] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:18:15.344224 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-33eccbac-a5b7-401d-ae82-3fc4b5a84b55 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:15.356334 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-33eccbac-a5b7-401d-ae82-3fc4b5a84b55 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1319 microversion: 2.1 time: 0.384600 Apr 05 11:18:15.357262 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 377/732] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:14 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:15.551693 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f6bcc0aa-3f49-4944-bbbc-6564fe9c57e4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:15.552578 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f6bcc0aa-3f49-4944-bbbc-6564fe9c57e4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:15.559077 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f6bcc0aa-3f49-4944-bbbc-6564fe9c57e4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:15.566205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f6bcc0aa-3f49-4944-bbbc-6564fe9c57e4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:15.566205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f6bcc0aa-3f49-4944-bbbc-6564fe9c57e4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:15.566205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f6bcc0aa-3f49-4944-bbbc-6564fe9c57e4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:15.754965 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3a048f0d-319c-4633-ac4b-47dbd6b41e23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:15.756116 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3a048f0d-319c-4633-ac4b-47dbd6b41e23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:15.757774 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f6bcc0aa-3f49-4944-bbbc-6564fe9c57e4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:15.762314 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3a048f0d-319c-4633-ac4b-47dbd6b41e23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:15.762996 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3a048f0d-319c-4633-ac4b-47dbd6b41e23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:15.764198 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3a048f0d-319c-4633-ac4b-47dbd6b41e23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:15.764442 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3a048f0d-319c-4633-ac4b-47dbd6b41e23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:15.785151 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f6bcc0aa-3f49-4944-bbbc-6564fe9c57e4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.238219 Apr 05 11:18:15.800165 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 356/733] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:15 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:15.922329 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3a048f0d-319c-4633-ac4b-47dbd6b41e23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:15.931078 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3a048f0d-319c-4633-ac4b-47dbd6b41e23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:15.932661 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3a048f0d-319c-4633-ac4b-47dbd6b41e23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:15.933833 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3a048f0d-319c-4633-ac4b-47dbd6b41e23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1755 microversion: 2.20 time: 0.182968 Apr 05 11:18:15.934398 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 378/734] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:15 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:18:16.373395 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c42233bf-a132-4429-8fe2-86f252b5d6e9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:16.373992 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c42233bf-a132-4429-8fe2-86f252b5d6e9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:16.379807 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c42233bf-a132-4429-8fe2-86f252b5d6e9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:16.380260 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c42233bf-a132-4429-8fe2-86f252b5d6e9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:16.381580 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c42233bf-a132-4429-8fe2-86f252b5d6e9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:16.382013 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c42233bf-a132-4429-8fe2-86f252b5d6e9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:16.560337 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c42233bf-a132-4429-8fe2-86f252b5d6e9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:16.568169 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c42233bf-a132-4429-8fe2-86f252b5d6e9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1319 microversion: 2.1 time: 0.198573 Apr 05 11:18:16.568734 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 357/735] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:16 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:16.801646 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d7f7b42a-91cc-451c-bf3f-c49409fc6aba tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:16.802162 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d7f7b42a-91cc-451c-bf3f-c49409fc6aba tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:16.808578 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d7f7b42a-91cc-451c-bf3f-c49409fc6aba tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:16.809036 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d7f7b42a-91cc-451c-bf3f-c49409fc6aba tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:16.809799 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d7f7b42a-91cc-451c-bf3f-c49409fc6aba tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:16.810241 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d7f7b42a-91cc-451c-bf3f-c49409fc6aba tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:16.952377 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4848f818-b750-4bec-9da3-cb5eb9ecc6c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:16.953015 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4848f818-b750-4bec-9da3-cb5eb9ecc6c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:16.959250 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4848f818-b750-4bec-9da3-cb5eb9ecc6c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:16.959696 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4848f818-b750-4bec-9da3-cb5eb9ecc6c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:16.960484 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4848f818-b750-4bec-9da3-cb5eb9ecc6c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:16.960920 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4848f818-b750-4bec-9da3-cb5eb9ecc6c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:17.105672 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4848f818-b750-4bec-9da3-cb5eb9ecc6c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:17.115484 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4848f818-b750-4bec-9da3-cb5eb9ecc6c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:17.117084 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4848f818-b750-4bec-9da3-cb5eb9ecc6c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:17.118526 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4848f818-b750-4bec-9da3-cb5eb9ecc6c8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1755 microversion: 2.20 time: 0.170125 Apr 05 11:18:17.119417 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 358/736] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:16 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:18:17.206736 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d7f7b42a-91cc-451c-bf3f-c49409fc6aba tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:17.215083 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d7f7b42a-91cc-451c-bf3f-c49409fc6aba tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.417660 Apr 05 11:18:17.215757 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 379/737] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:16 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:17.584573 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2d52221e-0e0d-4546-af19-4b8f3b67d12c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:17.585187 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2d52221e-0e0d-4546-af19-4b8f3b67d12c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:17.591698 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d52221e-0e0d-4546-af19-4b8f3b67d12c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:17.592169 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d52221e-0e0d-4546-af19-4b8f3b67d12c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:17.592955 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d52221e-0e0d-4546-af19-4b8f3b67d12c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:17.593366 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d52221e-0e0d-4546-af19-4b8f3b67d12c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:17.731419 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2d52221e-0e0d-4546-af19-4b8f3b67d12c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:17.738741 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2d52221e-0e0d-4546-af19-4b8f3b67d12c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1319 microversion: 2.1 time: 0.157968 Apr 05 11:18:17.739307 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 359/738] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:17 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:18.137523 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-60922925-086a-47e1-92be-0fc0b59d9c3b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:18.138142 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-60922925-086a-47e1-92be-0fc0b59d9c3b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:18.144469 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-60922925-086a-47e1-92be-0fc0b59d9c3b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:18.144915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-60922925-086a-47e1-92be-0fc0b59d9c3b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:18.145684 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-60922925-086a-47e1-92be-0fc0b59d9c3b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:18.146774 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-60922925-086a-47e1-92be-0fc0b59d9c3b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:18.232318 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1edf6aa2-8055-446e-9bc4-e36c0c96cec6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:18.232935 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1edf6aa2-8055-446e-9bc4-e36c0c96cec6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:18.238999 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1edf6aa2-8055-446e-9bc4-e36c0c96cec6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:18.239454 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1edf6aa2-8055-446e-9bc4-e36c0c96cec6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:18.240225 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1edf6aa2-8055-446e-9bc4-e36c0c96cec6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:18.240663 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1edf6aa2-8055-446e-9bc4-e36c0c96cec6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:18.290143 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-60922925-086a-47e1-92be-0fc0b59d9c3b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:18.297426 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-60922925-086a-47e1-92be-0fc0b59d9c3b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:18.298953 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-60922925-086a-47e1-92be-0fc0b59d9c3b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:18.300146 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-60922925-086a-47e1-92be-0fc0b59d9c3b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1755 microversion: 2.20 time: 0.166492 Apr 05 11:18:18.300720 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 380/739] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:18 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:18:18.392449 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1edf6aa2-8055-446e-9bc4-e36c0c96cec6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:18.400270 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1edf6aa2-8055-446e-9bc4-e36c0c96cec6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.171835 Apr 05 11:18:18.401045 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 360/740] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:18 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:18.756168 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-160b69ad-b5b3-4f7e-8cc2-e4ebecc1937e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:18.756825 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-160b69ad-b5b3-4f7e-8cc2-e4ebecc1937e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:18.762763 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-160b69ad-b5b3-4f7e-8cc2-e4ebecc1937e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:18.763208 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-160b69ad-b5b3-4f7e-8cc2-e4ebecc1937e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:18.763960 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-160b69ad-b5b3-4f7e-8cc2-e4ebecc1937e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:18.764388 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-160b69ad-b5b3-4f7e-8cc2-e4ebecc1937e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:18.908676 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-160b69ad-b5b3-4f7e-8cc2-e4ebecc1937e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:18.916883 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-160b69ad-b5b3-4f7e-8cc2-e4ebecc1937e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1319 microversion: 2.1 time: 0.164500 Apr 05 11:18:18.917647 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 381/741] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:18 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:19.320126 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-070a07cd-124d-42e8-8fe9-488a9b8ae2c1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:19.320801 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-070a07cd-124d-42e8-8fe9-488a9b8ae2c1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:19.327476 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-070a07cd-124d-42e8-8fe9-488a9b8ae2c1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:19.327871 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-070a07cd-124d-42e8-8fe9-488a9b8ae2c1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:19.328675 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-070a07cd-124d-42e8-8fe9-488a9b8ae2c1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:19.329114 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-070a07cd-124d-42e8-8fe9-488a9b8ae2c1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:19.417705 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f03e3cdf-05f7-49e8-b819-7e673988099f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:19.418366 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f03e3cdf-05f7-49e8-b819-7e673988099f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:19.424650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f03e3cdf-05f7-49e8-b819-7e673988099f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:19.426419 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f03e3cdf-05f7-49e8-b819-7e673988099f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:19.426419 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f03e3cdf-05f7-49e8-b819-7e673988099f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:19.426419 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f03e3cdf-05f7-49e8-b819-7e673988099f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:19.466160 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-070a07cd-124d-42e8-8fe9-488a9b8ae2c1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:19.475626 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-070a07cd-124d-42e8-8fe9-488a9b8ae2c1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:19.478047 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-070a07cd-124d-42e8-8fe9-488a9b8ae2c1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:19.478424 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-070a07cd-124d-42e8-8fe9-488a9b8ae2c1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1755 microversion: 2.20 time: 0.162937 Apr 05 11:18:19.479015 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 361/742] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:19 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:19.564165 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f03e3cdf-05f7-49e8-b819-7e673988099f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:19.571592 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f03e3cdf-05f7-49e8-b819-7e673988099f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.157734 Apr 05 11:18:19.572167 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 382/743] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:19 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:19.933782 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c7cc1777-8216-495b-842b-e31ee97e4d99 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:19.934400 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c7cc1777-8216-495b-842b-e31ee97e4d99 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:19.940362 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c7cc1777-8216-495b-842b-e31ee97e4d99 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:19.940809 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c7cc1777-8216-495b-842b-e31ee97e4d99 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:19.941574 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c7cc1777-8216-495b-842b-e31ee97e4d99 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:19.942012 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c7cc1777-8216-495b-842b-e31ee97e4d99 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:20.072291 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c7cc1777-8216-495b-842b-e31ee97e4d99 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:20.079493 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c7cc1777-8216-495b-842b-e31ee97e4d99 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1319 microversion: 2.1 time: 0.149590 Apr 05 11:18:20.080058 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 362/744] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:19 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:20.497842 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-38b60272-0f23-4198-8d72-fa67442ef79f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:20.498431 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-38b60272-0f23-4198-8d72-fa67442ef79f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:20.504841 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38b60272-0f23-4198-8d72-fa67442ef79f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:20.505338 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38b60272-0f23-4198-8d72-fa67442ef79f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:20.506106 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38b60272-0f23-4198-8d72-fa67442ef79f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:20.507254 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38b60272-0f23-4198-8d72-fa67442ef79f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:20.588458 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-55734b90-293a-4742-99c4-9e86e28dc327 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:20.589072 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-55734b90-293a-4742-99c4-9e86e28dc327 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:20.595309 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-55734b90-293a-4742-99c4-9e86e28dc327 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:20.595758 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-55734b90-293a-4742-99c4-9e86e28dc327 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:20.596532 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-55734b90-293a-4742-99c4-9e86e28dc327 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:20.596962 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-55734b90-293a-4742-99c4-9e86e28dc327 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:20.638411 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-38b60272-0f23-4198-8d72-fa67442ef79f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:20.647067 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-38b60272-0f23-4198-8d72-fa67442ef79f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:20.648595 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-38b60272-0f23-4198-8d72-fa67442ef79f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:20.649732 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-38b60272-0f23-4198-8d72-fa67442ef79f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1755 microversion: 2.20 time: 0.156180 Apr 05 11:18:20.650290 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 383/745] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:20 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1755 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:20.736922 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-55734b90-293a-4742-99c4-9e86e28dc327 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:20.744969 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-55734b90-293a-4742-99c4-9e86e28dc327 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.160402 Apr 05 11:18:20.745541 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 363/746] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:20 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:21.096807 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-80d60dcb-87d3-4c6b-8356-ee33684f01ce tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:21.097423 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-80d60dcb-87d3-4c6b-8356-ee33684f01ce tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:21.103752 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80d60dcb-87d3-4c6b-8356-ee33684f01ce tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:21.104202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80d60dcb-87d3-4c6b-8356-ee33684f01ce tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:21.104974 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80d60dcb-87d3-4c6b-8356-ee33684f01ce tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:21.105406 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80d60dcb-87d3-4c6b-8356-ee33684f01ce tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:21.150857 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-348f1894-eacd-44ba-bac9-75cf1a1b207b req-99fb0200-23cd-4e5a-8ffd-ca2b5827897a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce13b8dc-7708-416a-b29b-d5cac40ad1a3", "name": "network-vif-plugged", "status": "completed", "tag": "103701da-a5c4-43b6-8514-24a0767fa475"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:18:21.159210 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-348f1894-eacd-44ba-bac9-75cf1a1b207b req-99fb0200-23cd-4e5a-8ffd-ca2b5827897a service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:21.159653 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-348f1894-eacd-44ba-bac9-75cf1a1b207b req-99fb0200-23cd-4e5a-8ffd-ca2b5827897a service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:21.176986 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-348f1894-eacd-44ba-bac9-75cf1a1b207b req-99fb0200-23cd-4e5a-8ffd-ca2b5827897a service nova] Creating event network-vif-plugged:103701da-a5c4-43b6-8514-24a0767fa475 for instance ce13b8dc-7708-416a-b29b-d5cac40ad1a3 on hv-cinder-81899 Apr 05 11:18:21.177158 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-348f1894-eacd-44ba-bac9-75cf1a1b207b req-99fb0200-23cd-4e5a-8ffd-ca2b5827897a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029999 Apr 05 11:18:21.177807 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 364/747] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:18:21.254136 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-80d60dcb-87d3-4c6b-8356-ee33684f01ce tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:21.261645 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-80d60dcb-87d3-4c6b-8356-ee33684f01ce tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1319 microversion: 2.1 time: 0.168691 Apr 05 11:18:21.262206 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 384/748] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:21 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:21.669748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-79833855-4d96-4a32-ade1-033f6d5d4f66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:21.670441 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-79833855-4d96-4a32-ade1-033f6d5d4f66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:21.676662 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79833855-4d96-4a32-ade1-033f6d5d4f66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:21.677105 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79833855-4d96-4a32-ade1-033f6d5d4f66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:21.677870 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79833855-4d96-4a32-ade1-033f6d5d4f66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:21.679291 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79833855-4d96-4a32-ade1-033f6d5d4f66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:21.762176 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-62872169-4539-4713-b610-807b56eeff6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:21.762888 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-62872169-4539-4713-b610-807b56eeff6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:21.769205 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62872169-4539-4713-b610-807b56eeff6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:21.769660 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62872169-4539-4713-b610-807b56eeff6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:21.770528 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62872169-4539-4713-b610-807b56eeff6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:21.771229 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62872169-4539-4713-b610-807b56eeff6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:21.936308 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-62872169-4539-4713-b610-807b56eeff6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:21.944914 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-62872169-4539-4713-b610-807b56eeff6e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.186865 Apr 05 11:18:21.945657 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 385/749] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:21 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:22.020256 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-79833855-4d96-4a32-ade1-033f6d5d4f66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:22.028800 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-79833855-4d96-4a32-ade1-033f6d5d4f66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:22.030299 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-79833855-4d96-4a32-ade1-033f6d5d4f66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:22.031492 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-79833855-4d96-4a32-ade1-033f6d5d4f66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1755 microversion: 2.20 time: 0.366936 Apr 05 11:18:22.032051 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 365/750] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:21 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1755 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:22.281030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9438f9c2-b48b-4c6a-95fc-55bb75a99404 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:22.281030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9438f9c2-b48b-4c6a-95fc-55bb75a99404 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:22.285473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9438f9c2-b48b-4c6a-95fc-55bb75a99404 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:22.285925 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9438f9c2-b48b-4c6a-95fc-55bb75a99404 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:22.286728 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9438f9c2-b48b-4c6a-95fc-55bb75a99404 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:22.287165 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9438f9c2-b48b-4c6a-95fc-55bb75a99404 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:22.421187 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9438f9c2-b48b-4c6a-95fc-55bb75a99404 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:22.428361 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9438f9c2-b48b-4c6a-95fc-55bb75a99404 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1319 microversion: 2.1 time: 0.153563 Apr 05 11:18:22.428928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 386/751] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:22 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:22.962030 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-119e483d-1e05-4aec-bb86-b7bee6a81420 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:22.962695 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-119e483d-1e05-4aec-bb86-b7bee6a81420 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:22.968943 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-119e483d-1e05-4aec-bb86-b7bee6a81420 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:22.969388 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-119e483d-1e05-4aec-bb86-b7bee6a81420 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:22.970201 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-119e483d-1e05-4aec-bb86-b7bee6a81420 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:22.970658 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-119e483d-1e05-4aec-bb86-b7bee6a81420 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:23.049735 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-de9c94a7-e2db-4edd-9625-d241f71eccea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:23.050349 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-de9c94a7-e2db-4edd-9625-d241f71eccea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:23.057844 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de9c94a7-e2db-4edd-9625-d241f71eccea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:23.058293 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de9c94a7-e2db-4edd-9625-d241f71eccea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:23.059272 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de9c94a7-e2db-4edd-9625-d241f71eccea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:23.059911 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de9c94a7-e2db-4edd-9625-d241f71eccea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:23.110987 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-119e483d-1e05-4aec-bb86-b7bee6a81420 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:23.118780 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-119e483d-1e05-4aec-bb86-b7bee6a81420 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.160862 Apr 05 11:18:23.119443 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 366/752] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:22 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:23.207784 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-de9c94a7-e2db-4edd-9625-d241f71eccea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:23.216710 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-de9c94a7-e2db-4edd-9625-d241f71eccea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:23.218208 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-de9c94a7-e2db-4edd-9625-d241f71eccea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:23.219414 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-de9c94a7-e2db-4edd-9625-d241f71eccea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.173960 Apr 05 11:18:23.220235 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 387/753] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:23 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:18:23.445923 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9451fac4-8a86-4200-9b27-37da9530abeb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:23.446543 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9451fac4-8a86-4200-9b27-37da9530abeb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:23.452598 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9451fac4-8a86-4200-9b27-37da9530abeb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:23.453052 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9451fac4-8a86-4200-9b27-37da9530abeb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:23.453819 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9451fac4-8a86-4200-9b27-37da9530abeb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:23.454262 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9451fac4-8a86-4200-9b27-37da9530abeb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:23.591319 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9451fac4-8a86-4200-9b27-37da9530abeb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:23.598690 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9451fac4-8a86-4200-9b27-37da9530abeb tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1319 microversion: 2.1 time: 0.157182 Apr 05 11:18:23.599260 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 367/754] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:23 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:24.136226 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-971646f5-2e15-4fd3-9273-8cc957c62d3a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:24.137560 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-971646f5-2e15-4fd3-9273-8cc957c62d3a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:24.144388 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-971646f5-2e15-4fd3-9273-8cc957c62d3a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:24.144796 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-971646f5-2e15-4fd3-9273-8cc957c62d3a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:24.145809 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-971646f5-2e15-4fd3-9273-8cc957c62d3a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:24.146067 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-971646f5-2e15-4fd3-9273-8cc957c62d3a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:24.237711 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8e32ba09-babd-44c9-9388-91c198d6d934 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:24.238370 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8e32ba09-babd-44c9-9388-91c198d6d934 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:24.246148 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e32ba09-babd-44c9-9388-91c198d6d934 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:24.246900 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e32ba09-babd-44c9-9388-91c198d6d934 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:24.247868 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e32ba09-babd-44c9-9388-91c198d6d934 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:24.249527 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e32ba09-babd-44c9-9388-91c198d6d934 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:24.429491 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-971646f5-2e15-4fd3-9273-8cc957c62d3a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:24.437125 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-971646f5-2e15-4fd3-9273-8cc957c62d3a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.304781 Apr 05 11:18:24.437897 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 388/755] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:24 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:24.443537 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8e32ba09-babd-44c9-9388-91c198d6d934 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:24.452274 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8e32ba09-babd-44c9-9388-91c198d6d934 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:24.453938 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8e32ba09-babd-44c9-9388-91c198d6d934 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:24.455115 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8e32ba09-babd-44c9-9388-91c198d6d934 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.221790 Apr 05 11:18:24.455690 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 368/756] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:24 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:24.615066 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d0881dd5-bb0d-4a18-b974-4df82859aee5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:24.615685 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d0881dd5-bb0d-4a18-b974-4df82859aee5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:24.621998 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0881dd5-bb0d-4a18-b974-4df82859aee5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:24.622424 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0881dd5-bb0d-4a18-b974-4df82859aee5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:24.623230 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0881dd5-bb0d-4a18-b974-4df82859aee5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:24.623696 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0881dd5-bb0d-4a18-b974-4df82859aee5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:24.760213 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d0881dd5-bb0d-4a18-b974-4df82859aee5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:24.767505 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d0881dd5-bb0d-4a18-b974-4df82859aee5 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1319 microversion: 2.1 time: 0.156286 Apr 05 11:18:24.768083 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 389/757] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:24 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:25.453179 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-60f0103e-c2df-4b4d-965a-10511f35305e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:25.453767 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-60f0103e-c2df-4b4d-965a-10511f35305e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:25.461159 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-60f0103e-c2df-4b4d-965a-10511f35305e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:25.461611 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-60f0103e-c2df-4b4d-965a-10511f35305e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:25.462593 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-60f0103e-c2df-4b4d-965a-10511f35305e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:25.463416 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-60f0103e-c2df-4b4d-965a-10511f35305e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:25.474337 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-91d0d342-ca94-410d-b660-7bd129b23790 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:25.475330 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-91d0d342-ca94-410d-b660-7bd129b23790 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:25.484291 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-91d0d342-ca94-410d-b660-7bd129b23790 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:25.485002 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-91d0d342-ca94-410d-b660-7bd129b23790 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:25.486228 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-91d0d342-ca94-410d-b660-7bd129b23790 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:25.486749 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-91d0d342-ca94-410d-b660-7bd129b23790 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:25.699849 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-91d0d342-ca94-410d-b660-7bd129b23790 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:25.704222 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-60f0103e-c2df-4b4d-965a-10511f35305e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:25.710538 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-91d0d342-ca94-410d-b660-7bd129b23790 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:25.712222 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-91d0d342-ca94-410d-b660-7bd129b23790 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:25.714024 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-91d0d342-ca94-410d-b660-7bd129b23790 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.243667 Apr 05 11:18:25.714499 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 390/758] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:25 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:25.718245 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-60f0103e-c2df-4b4d-965a-10511f35305e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.268838 Apr 05 11:18:25.719274 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 369/759] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:25 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:25.737726 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-b2a2b745-b5f8-4738-8fad-dae893851d9c req-7bf02604-8c41-4e5c-b9e3-913af7d578df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4e16432-3df3-4325-b757-906fbbeca604", "name": "network-vif-plugged", "status": "completed", "tag": "dc377578-0184-4a80-88e0-2385eab5c0c4"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:18:25.746051 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-b2a2b745-b5f8-4738-8fad-dae893851d9c req-7bf02604-8c41-4e5c-b9e3-913af7d578df service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:25.746496 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-b2a2b745-b5f8-4738-8fad-dae893851d9c req-7bf02604-8c41-4e5c-b9e3-913af7d578df service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:25.757057 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-b2a2b745-b5f8-4738-8fad-dae893851d9c req-7bf02604-8c41-4e5c-b9e3-913af7d578df service nova] Creating event network-vif-plugged:dc377578-0184-4a80-88e0-2385eab5c0c4 for instance e4e16432-3df3-4325-b757-906fbbeca604 on hv-cinder-81899 Apr 05 11:18:25.762319 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-b2a2b745-b5f8-4738-8fad-dae893851d9c req-7bf02604-8c41-4e5c-b9e3-913af7d578df service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028838 Apr 05 11:18:25.762940 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 391/760] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:18:25.784699 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-10627b22-01f6-4805-ad2f-1ba0d7d4ba83 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:25.785305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-10627b22-01f6-4805-ad2f-1ba0d7d4ba83 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:25.798944 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10627b22-01f6-4805-ad2f-1ba0d7d4ba83 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:25.799404 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10627b22-01f6-4805-ad2f-1ba0d7d4ba83 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:25.800181 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10627b22-01f6-4805-ad2f-1ba0d7d4ba83 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:25.800627 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10627b22-01f6-4805-ad2f-1ba0d7d4ba83 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:25.952145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-10627b22-01f6-4805-ad2f-1ba0d7d4ba83 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:25.960805 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-10627b22-01f6-4805-ad2f-1ba0d7d4ba83 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1507 microversion: 2.1 time: 0.179659 Apr 05 11:18:25.973778 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 370/761] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:25 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:25.979868 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-030bcfeb-8fff-4db0-ac08-c62936a8e3d3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0694799-ac94-4fde-bcd5-c807f34f3813", "device": "/dev/sdb"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:18:25.981081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-030bcfeb-8fff-4db0-ac08-c62936a8e3d3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:25.987452 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-030bcfeb-8fff-4db0-ac08-c62936a8e3d3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:25.987902 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-030bcfeb-8fff-4db0-ac08-c62936a8e3d3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:25.989649 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-030bcfeb-8fff-4db0-ac08-c62936a8e3d3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:25.990090 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-030bcfeb-8fff-4db0-ac08-c62936a8e3d3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:26.733053 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e358a06b-656d-4c71-b240-1a11a2a0ce69 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:26.733929 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e358a06b-656d-4c71-b240-1a11a2a0ce69 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:26.744949 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e358a06b-656d-4c71-b240-1a11a2a0ce69 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:26.745863 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e358a06b-656d-4c71-b240-1a11a2a0ce69 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:26.746966 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e358a06b-656d-4c71-b240-1a11a2a0ce69 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:26.747555 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e358a06b-656d-4c71-b240-1a11a2a0ce69 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:27.183348 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e358a06b-656d-4c71-b240-1a11a2a0ce69 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:27.183348 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e358a06b-656d-4c71-b240-1a11a2a0ce69 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:27.184378 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e358a06b-656d-4c71-b240-1a11a2a0ce69 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:27.184378 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e358a06b-656d-4c71-b240-1a11a2a0ce69 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.230558 Apr 05 11:18:27.184378 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 371/762] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:26 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:18:27.184378 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a5525469-5a42-434e-ac61-9ca711b1507f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:27.185526 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a5525469-5a42-434e-ac61-9ca711b1507f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:27.185526 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5525469-5a42-434e-ac61-9ca711b1507f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:27.185526 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5525469-5a42-434e-ac61-9ca711b1507f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:27.185526 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5525469-5a42-434e-ac61-9ca711b1507f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:27.185864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5525469-5a42-434e-ac61-9ca711b1507f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:27.185864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a5525469-5a42-434e-ac61-9ca711b1507f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:27.185864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a5525469-5a42-434e-ac61-9ca711b1507f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.163110 Apr 05 11:18:27.185864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 372/763] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:26 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:27.317680 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-030bcfeb-8fff-4db0-ac08-c62936a8e3d3 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "POST /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.318429 Apr 05 11:18:27.317680 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 392/764] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:18:25 2022] POST /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3/os-volume_attachments => generated 194 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:18:28.168058 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fd68181c-80b0-425e-bc60-c3b5bd8adf62 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:28.168667 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fd68181c-80b0-425e-bc60-c3b5bd8adf62 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:28.175133 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fd68181c-80b0-425e-bc60-c3b5bd8adf62 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:28.175584 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fd68181c-80b0-425e-bc60-c3b5bd8adf62 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:28.176380 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fd68181c-80b0-425e-bc60-c3b5bd8adf62 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:28.176811 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fd68181c-80b0-425e-bc60-c3b5bd8adf62 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:28.177300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef7df29c-b1bc-45ea-ae36-39f227e45814 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:28.177997 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ef7df29c-b1bc-45ea-ae36-39f227e45814 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:28.185089 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef7df29c-b1bc-45ea-ae36-39f227e45814 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:28.185748 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef7df29c-b1bc-45ea-ae36-39f227e45814 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:28.186712 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef7df29c-b1bc-45ea-ae36-39f227e45814 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:28.187291 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef7df29c-b1bc-45ea-ae36-39f227e45814 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:28.349844 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fd68181c-80b0-425e-bc60-c3b5bd8adf62 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:28.358288 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fd68181c-80b0-425e-bc60-c3b5bd8adf62 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.193950 Apr 05 11:18:28.368049 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 373/765] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:28 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:18:28.402975 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef7df29c-b1bc-45ea-ae36-39f227e45814 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:28.411390 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef7df29c-b1bc-45ea-ae36-39f227e45814 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:28.412886 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef7df29c-b1bc-45ea-ae36-39f227e45814 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:28.414046 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ef7df29c-b1bc-45ea-ae36-39f227e45814 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.241274 Apr 05 11:18:28.422663 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 393/766] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:28 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:29.375735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-259b8a57-dcaf-41fc-8a68-bccfd6e55bc7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:29.376342 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-259b8a57-dcaf-41fc-8a68-bccfd6e55bc7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:29.382881 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-259b8a57-dcaf-41fc-8a68-bccfd6e55bc7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:29.383343 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-259b8a57-dcaf-41fc-8a68-bccfd6e55bc7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:29.384159 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-259b8a57-dcaf-41fc-8a68-bccfd6e55bc7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:29.384600 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-259b8a57-dcaf-41fc-8a68-bccfd6e55bc7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:29.433023 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-05e13ba8-ba37-4387-95bd-d75eb294865f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:29.433624 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-05e13ba8-ba37-4387-95bd-d75eb294865f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:29.440110 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-05e13ba8-ba37-4387-95bd-d75eb294865f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:29.442834 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-05e13ba8-ba37-4387-95bd-d75eb294865f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:29.442834 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-05e13ba8-ba37-4387-95bd-d75eb294865f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:29.442834 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-05e13ba8-ba37-4387-95bd-d75eb294865f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:29.544358 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-259b8a57-dcaf-41fc-8a68-bccfd6e55bc7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:29.551687 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-259b8a57-dcaf-41fc-8a68-bccfd6e55bc7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.179846 Apr 05 11:18:29.552259 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 374/767] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:29 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:29.590548 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-05e13ba8-ba37-4387-95bd-d75eb294865f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:29.600536 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-05e13ba8-ba37-4387-95bd-d75eb294865f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:29.602079 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-05e13ba8-ba37-4387-95bd-d75eb294865f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:29.604222 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-05e13ba8-ba37-4387-95bd-d75eb294865f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.174903 Apr 05 11:18:29.604785 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 394/768] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:29 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:18:30.570177 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bcdd34b3-a917-4245-9f49-6ea6c1bef7e3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:30.571938 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bcdd34b3-a917-4245-9f49-6ea6c1bef7e3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:30.578579 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bcdd34b3-a917-4245-9f49-6ea6c1bef7e3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:30.579059 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bcdd34b3-a917-4245-9f49-6ea6c1bef7e3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:30.579851 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bcdd34b3-a917-4245-9f49-6ea6c1bef7e3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:30.580287 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bcdd34b3-a917-4245-9f49-6ea6c1bef7e3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:30.623113 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1dff5d53-8794-43fc-9c6f-badb4d254ab5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:30.623735 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1dff5d53-8794-43fc-9c6f-badb4d254ab5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:30.629928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1dff5d53-8794-43fc-9c6f-badb4d254ab5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:30.630382 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1dff5d53-8794-43fc-9c6f-badb4d254ab5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:30.631170 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1dff5d53-8794-43fc-9c6f-badb4d254ab5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:30.631599 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1dff5d53-8794-43fc-9c6f-badb4d254ab5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:30.747286 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bcdd34b3-a917-4245-9f49-6ea6c1bef7e3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:30.754569 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bcdd34b3-a917-4245-9f49-6ea6c1bef7e3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.188978 Apr 05 11:18:30.755167 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 375/769] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:30 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:30.773255 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1dff5d53-8794-43fc-9c6f-badb4d254ab5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:30.782874 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1dff5d53-8794-43fc-9c6f-badb4d254ab5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:30.784332 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1dff5d53-8794-43fc-9c6f-badb4d254ab5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:30.785536 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1dff5d53-8794-43fc-9c6f-badb4d254ab5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.166406 Apr 05 11:18:30.789932 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 395/770] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:30 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:18:31.771430 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ecd4f5a9-258c-46e0-8de6-73910bba4a73 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:31.772048 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ecd4f5a9-258c-46e0-8de6-73910bba4a73 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:31.778347 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ecd4f5a9-258c-46e0-8de6-73910bba4a73 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:31.778927 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ecd4f5a9-258c-46e0-8de6-73910bba4a73 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:31.783136 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ecd4f5a9-258c-46e0-8de6-73910bba4a73 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:31.783136 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ecd4f5a9-258c-46e0-8de6-73910bba4a73 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:31.812912 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-877f2c49-38b2-42fc-8661-0684a7935152 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:31.814188 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-877f2c49-38b2-42fc-8661-0684a7935152 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:31.820678 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-877f2c49-38b2-42fc-8661-0684a7935152 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:31.821123 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-877f2c49-38b2-42fc-8661-0684a7935152 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:31.821885 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-877f2c49-38b2-42fc-8661-0684a7935152 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:31.822315 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-877f2c49-38b2-42fc-8661-0684a7935152 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:31.924532 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ecd4f5a9-258c-46e0-8de6-73910bba4a73 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:31.932548 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ecd4f5a9-258c-46e0-8de6-73910bba4a73 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.165119 Apr 05 11:18:31.933124 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 376/771] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:31 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:31.973599 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-877f2c49-38b2-42fc-8661-0684a7935152 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:31.982551 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-877f2c49-38b2-42fc-8661-0684a7935152 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:31.984070 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-877f2c49-38b2-42fc-8661-0684a7935152 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:31.985216 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-877f2c49-38b2-42fc-8661-0684a7935152 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.184642 Apr 05 11:18:31.985765 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 396/772] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:31 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:18:32.951195 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a6e5550e-6311-47f7-bce3-4cd028387a21 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:32.952098 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a6e5550e-6311-47f7-bce3-4cd028387a21 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:32.959495 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6e5550e-6311-47f7-bce3-4cd028387a21 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:32.959883 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6e5550e-6311-47f7-bce3-4cd028387a21 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:32.960687 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6e5550e-6311-47f7-bce3-4cd028387a21 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:32.961124 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6e5550e-6311-47f7-bce3-4cd028387a21 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:33.105442 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a6e5550e-6311-47f7-bce3-4cd028387a21 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:33.113460 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a6e5550e-6311-47f7-bce3-4cd028387a21 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.166558 Apr 05 11:18:33.119434 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 377/773] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:32 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:33.126891 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7c5d1a9a-bd82-43be-910e-27b08f9502f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:33.128092 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7c5d1a9a-bd82-43be-910e-27b08f9502f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:33.137184 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c5d1a9a-bd82-43be-910e-27b08f9502f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:33.137184 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c5d1a9a-bd82-43be-910e-27b08f9502f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:33.137184 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c5d1a9a-bd82-43be-910e-27b08f9502f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:33.137573 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c5d1a9a-bd82-43be-910e-27b08f9502f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:33.297993 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c5d1a9a-bd82-43be-910e-27b08f9502f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:33.307326 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c5d1a9a-bd82-43be-910e-27b08f9502f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:33.308903 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c5d1a9a-bd82-43be-910e-27b08f9502f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:33.310081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7c5d1a9a-bd82-43be-910e-27b08f9502f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.309323 Apr 05 11:18:33.310650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 397/774] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:32 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:18:34.131105 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-61d64cb4-8e50-4715-b941-996f95ad007d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:34.131767 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-61d64cb4-8e50-4715-b941-996f95ad007d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:34.138540 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-61d64cb4-8e50-4715-b941-996f95ad007d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:34.139019 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-61d64cb4-8e50-4715-b941-996f95ad007d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:34.143423 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-61d64cb4-8e50-4715-b941-996f95ad007d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:34.143423 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-61d64cb4-8e50-4715-b941-996f95ad007d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:34.328342 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b84b30c5-d284-4f53-a510-34def639bd67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:34.328941 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b84b30c5-d284-4f53-a510-34def639bd67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:34.335536 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b84b30c5-d284-4f53-a510-34def639bd67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:34.335999 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b84b30c5-d284-4f53-a510-34def639bd67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:34.336754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b84b30c5-d284-4f53-a510-34def639bd67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:34.337531 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b84b30c5-d284-4f53-a510-34def639bd67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:34.350341 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-61d64cb4-8e50-4715-b941-996f95ad007d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:34.359181 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-61d64cb4-8e50-4715-b941-996f95ad007d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.232059 Apr 05 11:18:34.359757 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 378/775] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:34 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:34.519962 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b84b30c5-d284-4f53-a510-34def639bd67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:34.529003 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b84b30c5-d284-4f53-a510-34def639bd67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:34.531552 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b84b30c5-d284-4f53-a510-34def639bd67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:34.535606 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b84b30c5-d284-4f53-a510-34def639bd67 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.208266 Apr 05 11:18:34.535606 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 398/776] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:34 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:35.376277 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5b247536-dcb2-48e7-babe-4b54320108db tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:35.376936 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5b247536-dcb2-48e7-babe-4b54320108db tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:35.383533 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5b247536-dcb2-48e7-babe-4b54320108db tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:35.383983 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5b247536-dcb2-48e7-babe-4b54320108db tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:35.384760 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5b247536-dcb2-48e7-babe-4b54320108db tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:35.385843 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5b247536-dcb2-48e7-babe-4b54320108db tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:35.528728 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5b247536-dcb2-48e7-babe-4b54320108db tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:35.535825 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5b247536-dcb2-48e7-babe-4b54320108db tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.163740 Apr 05 11:18:35.536657 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 379/777] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:35 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:35.550483 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5e4875ee-f94a-434a-b53f-c88ba6fa5625 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:35.551492 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5e4875ee-f94a-434a-b53f-c88ba6fa5625 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:35.558656 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5e4875ee-f94a-434a-b53f-c88ba6fa5625 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:35.559112 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5e4875ee-f94a-434a-b53f-c88ba6fa5625 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:35.559888 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5e4875ee-f94a-434a-b53f-c88ba6fa5625 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:35.560325 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5e4875ee-f94a-434a-b53f-c88ba6fa5625 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:35.723623 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5e4875ee-f94a-434a-b53f-c88ba6fa5625 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:35.738056 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5e4875ee-f94a-434a-b53f-c88ba6fa5625 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:35.739842 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5e4875ee-f94a-434a-b53f-c88ba6fa5625 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:35.741048 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5e4875ee-f94a-434a-b53f-c88ba6fa5625 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.194545 Apr 05 11:18:35.741921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 399/778] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:35 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:36.555341 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7626bd2d-8f24-40ae-9e5b-6cdbf787a4c4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:36.556469 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7626bd2d-8f24-40ae-9e5b-6cdbf787a4c4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:36.569748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7626bd2d-8f24-40ae-9e5b-6cdbf787a4c4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:36.570198 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7626bd2d-8f24-40ae-9e5b-6cdbf787a4c4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:36.570989 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7626bd2d-8f24-40ae-9e5b-6cdbf787a4c4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:36.571418 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7626bd2d-8f24-40ae-9e5b-6cdbf787a4c4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:36.717007 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7626bd2d-8f24-40ae-9e5b-6cdbf787a4c4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:36.725160 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7626bd2d-8f24-40ae-9e5b-6cdbf787a4c4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.174621 Apr 05 11:18:36.725779 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 380/779] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:36 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:36.761457 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ee980c90-0214-40b9-98a2-186bf77c312d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:36.762064 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ee980c90-0214-40b9-98a2-186bf77c312d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:36.772494 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ee980c90-0214-40b9-98a2-186bf77c312d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:36.773581 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ee980c90-0214-40b9-98a2-186bf77c312d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:36.780019 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ee980c90-0214-40b9-98a2-186bf77c312d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:36.780533 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ee980c90-0214-40b9-98a2-186bf77c312d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:36.936733 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ee980c90-0214-40b9-98a2-186bf77c312d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:36.949891 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ee980c90-0214-40b9-98a2-186bf77c312d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:36.951560 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ee980c90-0214-40b9-98a2-186bf77c312d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:36.956201 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ee980c90-0214-40b9-98a2-186bf77c312d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.196194 Apr 05 11:18:36.956811 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 400/780] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:36 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:37.744063 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-25ca55e6-5dd5-4229-ba64-ae0166451319 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:37.744698 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-25ca55e6-5dd5-4229-ba64-ae0166451319 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:37.751568 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-25ca55e6-5dd5-4229-ba64-ae0166451319 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:37.752017 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-25ca55e6-5dd5-4229-ba64-ae0166451319 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:37.752858 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-25ca55e6-5dd5-4229-ba64-ae0166451319 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:37.753478 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-25ca55e6-5dd5-4229-ba64-ae0166451319 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:37.896384 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-25ca55e6-5dd5-4229-ba64-ae0166451319 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:37.904367 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-25ca55e6-5dd5-4229-ba64-ae0166451319 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.164633 Apr 05 11:18:37.909626 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 381/781] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:37 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:37.975148 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8cdc339e-93be-43d7-857e-5a6075ca937b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:37.975763 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8cdc339e-93be-43d7-857e-5a6075ca937b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:37.982183 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8cdc339e-93be-43d7-857e-5a6075ca937b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:37.982581 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8cdc339e-93be-43d7-857e-5a6075ca937b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:37.983389 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8cdc339e-93be-43d7-857e-5a6075ca937b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:37.983822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8cdc339e-93be-43d7-857e-5a6075ca937b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:38.121476 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8cdc339e-93be-43d7-857e-5a6075ca937b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:38.130383 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8cdc339e-93be-43d7-857e-5a6075ca937b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:38.132189 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8cdc339e-93be-43d7-857e-5a6075ca937b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:38.133541 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8cdc339e-93be-43d7-857e-5a6075ca937b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.162299 Apr 05 11:18:38.134577 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 401/782] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:37 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:38.920725 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3f8e254e-755d-4818-988f-96d71c3431b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:38.921426 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3f8e254e-755d-4818-988f-96d71c3431b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:38.927640 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3f8e254e-755d-4818-988f-96d71c3431b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:38.928092 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3f8e254e-755d-4818-988f-96d71c3431b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:38.928856 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3f8e254e-755d-4818-988f-96d71c3431b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:38.929291 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3f8e254e-755d-4818-988f-96d71c3431b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:39.064822 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3f8e254e-755d-4818-988f-96d71c3431b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:39.072387 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3f8e254e-755d-4818-988f-96d71c3431b4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.155562 Apr 05 11:18:39.073008 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 382/783] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:38 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:39.152524 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1e006530-4458-4a9f-b5dd-4b5e0f2fa174 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:39.153118 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1e006530-4458-4a9f-b5dd-4b5e0f2fa174 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:39.159547 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1e006530-4458-4a9f-b5dd-4b5e0f2fa174 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:39.159996 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1e006530-4458-4a9f-b5dd-4b5e0f2fa174 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:39.160859 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1e006530-4458-4a9f-b5dd-4b5e0f2fa174 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:39.161297 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1e006530-4458-4a9f-b5dd-4b5e0f2fa174 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:39.313230 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1e006530-4458-4a9f-b5dd-4b5e0f2fa174 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:39.321556 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1e006530-4458-4a9f-b5dd-4b5e0f2fa174 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:39.323091 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1e006530-4458-4a9f-b5dd-4b5e0f2fa174 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:39.324538 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1e006530-4458-4a9f-b5dd-4b5e0f2fa174 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.175884 Apr 05 11:18:39.325150 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 402/784] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:39 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:40.094101 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f1d53590-8fce-48d4-beac-bc2f660d4e51 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:40.108137 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f1d53590-8fce-48d4-beac-bc2f660d4e51 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:40.108137 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f1d53590-8fce-48d4-beac-bc2f660d4e51 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:40.108137 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f1d53590-8fce-48d4-beac-bc2f660d4e51 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:40.108137 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f1d53590-8fce-48d4-beac-bc2f660d4e51 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:40.108760 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f1d53590-8fce-48d4-beac-bc2f660d4e51 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:40.251668 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f1d53590-8fce-48d4-beac-bc2f660d4e51 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:40.259978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f1d53590-8fce-48d4-beac-bc2f660d4e51 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.172159 Apr 05 11:18:40.268286 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 383/785] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:40 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:40.343016 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-adb54ddc-0da1-4fad-8f22-be2b97c1b0a2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:40.350473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-adb54ddc-0da1-4fad-8f22-be2b97c1b0a2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:40.350473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-adb54ddc-0da1-4fad-8f22-be2b97c1b0a2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:40.350473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-adb54ddc-0da1-4fad-8f22-be2b97c1b0a2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:40.351176 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-adb54ddc-0da1-4fad-8f22-be2b97c1b0a2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:40.351608 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-adb54ddc-0da1-4fad-8f22-be2b97c1b0a2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:40.486689 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-adb54ddc-0da1-4fad-8f22-be2b97c1b0a2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:40.495109 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-adb54ddc-0da1-4fad-8f22-be2b97c1b0a2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:40.497183 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-adb54ddc-0da1-4fad-8f22-be2b97c1b0a2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:40.498317 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-adb54ddc-0da1-4fad-8f22-be2b97c1b0a2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.159384 Apr 05 11:18:40.498918 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 403/786] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:40 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:18:41.279369 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-12ed2cfe-7555-4ec9-9e2d-f6abcc1f862a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:41.279980 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-12ed2cfe-7555-4ec9-9e2d-f6abcc1f862a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:41.286700 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-12ed2cfe-7555-4ec9-9e2d-f6abcc1f862a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:41.287223 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-12ed2cfe-7555-4ec9-9e2d-f6abcc1f862a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:41.288034 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-12ed2cfe-7555-4ec9-9e2d-f6abcc1f862a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:41.288469 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-12ed2cfe-7555-4ec9-9e2d-f6abcc1f862a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:41.428383 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-12ed2cfe-7555-4ec9-9e2d-f6abcc1f862a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:41.436440 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-12ed2cfe-7555-4ec9-9e2d-f6abcc1f862a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.160922 Apr 05 11:18:41.437006 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 384/787] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:41 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:41.516521 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6dcfac99-9c93-4a0d-b2ad-c247924cb97c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:41.517141 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6dcfac99-9c93-4a0d-b2ad-c247924cb97c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:41.523715 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6dcfac99-9c93-4a0d-b2ad-c247924cb97c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:41.524257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6dcfac99-9c93-4a0d-b2ad-c247924cb97c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:41.525238 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6dcfac99-9c93-4a0d-b2ad-c247924cb97c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:41.525675 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6dcfac99-9c93-4a0d-b2ad-c247924cb97c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:41.675297 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6dcfac99-9c93-4a0d-b2ad-c247924cb97c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:41.684953 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6dcfac99-9c93-4a0d-b2ad-c247924cb97c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:41.686392 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6dcfac99-9c93-4a0d-b2ad-c247924cb97c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:41.687568 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6dcfac99-9c93-4a0d-b2ad-c247924cb97c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.174960 Apr 05 11:18:41.688119 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 404/788] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:41 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:42.464956 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-80f4c15f-2d75-431e-a8c9-b262a209f37c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:42.465519 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-80f4c15f-2d75-431e-a8c9-b262a209f37c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:42.471978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-80f4c15f-2d75-431e-a8c9-b262a209f37c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:42.472652 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-80f4c15f-2d75-431e-a8c9-b262a209f37c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:42.473184 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-80f4c15f-2d75-431e-a8c9-b262a209f37c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:42.473620 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-80f4c15f-2d75-431e-a8c9-b262a209f37c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:42.606569 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-80f4c15f-2d75-431e-a8c9-b262a209f37c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:42.614222 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-80f4c15f-2d75-431e-a8c9-b262a209f37c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.153091 Apr 05 11:18:42.614817 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 385/789] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:42 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:42.706290 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-31b3b4ee-588c-47cb-adf6-162b801e0472 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:42.706928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-31b3b4ee-588c-47cb-adf6-162b801e0472 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:42.713305 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-31b3b4ee-588c-47cb-adf6-162b801e0472 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:42.713757 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-31b3b4ee-588c-47cb-adf6-162b801e0472 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:42.714598 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-31b3b4ee-588c-47cb-adf6-162b801e0472 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:42.715114 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-31b3b4ee-588c-47cb-adf6-162b801e0472 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:42.851768 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-31b3b4ee-588c-47cb-adf6-162b801e0472 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:42.860625 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-31b3b4ee-588c-47cb-adf6-162b801e0472 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:42.862127 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-31b3b4ee-588c-47cb-adf6-162b801e0472 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:42.863305 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-31b3b4ee-588c-47cb-adf6-162b801e0472 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.161559 Apr 05 11:18:42.863869 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 405/790] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:42 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:43.630419 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-13edc257-0f8f-4a3c-9914-cade40ad1f61 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:43.631063 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-13edc257-0f8f-4a3c-9914-cade40ad1f61 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:43.637383 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-13edc257-0f8f-4a3c-9914-cade40ad1f61 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:43.637834 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-13edc257-0f8f-4a3c-9914-cade40ad1f61 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:43.638686 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-13edc257-0f8f-4a3c-9914-cade40ad1f61 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:43.639078 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-13edc257-0f8f-4a3c-9914-cade40ad1f61 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:43.772202 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-13edc257-0f8f-4a3c-9914-cade40ad1f61 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:43.779449 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-13edc257-0f8f-4a3c-9914-cade40ad1f61 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.152846 Apr 05 11:18:43.780009 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 386/791] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:43 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:43.881783 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b7530ae3-4e5c-4f93-b105-b82f70d2791c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:43.882324 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b7530ae3-4e5c-4f93-b105-b82f70d2791c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:43.888570 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b7530ae3-4e5c-4f93-b105-b82f70d2791c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:43.889020 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b7530ae3-4e5c-4f93-b105-b82f70d2791c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:43.889925 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b7530ae3-4e5c-4f93-b105-b82f70d2791c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:43.890367 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b7530ae3-4e5c-4f93-b105-b82f70d2791c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:44.020146 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b7530ae3-4e5c-4f93-b105-b82f70d2791c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:44.029132 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b7530ae3-4e5c-4f93-b105-b82f70d2791c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:44.030708 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b7530ae3-4e5c-4f93-b105-b82f70d2791c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:44.031885 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b7530ae3-4e5c-4f93-b105-b82f70d2791c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.154128 Apr 05 11:18:44.032450 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 406/792] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:43 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:44.796601 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e5cc95c2-b77a-4e7c-9717-29b5d4f2dda7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:44.797204 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e5cc95c2-b77a-4e7c-9717-29b5d4f2dda7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:44.803504 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e5cc95c2-b77a-4e7c-9717-29b5d4f2dda7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:44.803951 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e5cc95c2-b77a-4e7c-9717-29b5d4f2dda7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:44.804710 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e5cc95c2-b77a-4e7c-9717-29b5d4f2dda7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:44.805142 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e5cc95c2-b77a-4e7c-9717-29b5d4f2dda7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:44.936965 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e5cc95c2-b77a-4e7c-9717-29b5d4f2dda7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:44.944167 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e5cc95c2-b77a-4e7c-9717-29b5d4f2dda7 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.151423 Apr 05 11:18:44.944729 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 387/793] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:44 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:45.049256 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-783d4cdd-7d94-4cd7-8e4b-3b5bcfed38b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:45.049855 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-783d4cdd-7d94-4cd7-8e4b-3b5bcfed38b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:45.056122 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-783d4cdd-7d94-4cd7-8e4b-3b5bcfed38b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:45.056566 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-783d4cdd-7d94-4cd7-8e4b-3b5bcfed38b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:45.057322 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-783d4cdd-7d94-4cd7-8e4b-3b5bcfed38b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:45.057750 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-783d4cdd-7d94-4cd7-8e4b-3b5bcfed38b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:45.193146 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-783d4cdd-7d94-4cd7-8e4b-3b5bcfed38b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:45.201513 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-783d4cdd-7d94-4cd7-8e4b-3b5bcfed38b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:45.203051 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-783d4cdd-7d94-4cd7-8e4b-3b5bcfed38b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:45.204200 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-783d4cdd-7d94-4cd7-8e4b-3b5bcfed38b7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.158828 Apr 05 11:18:45.204763 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 407/794] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:45 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:45.961611 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-45035da7-697c-4877-8ed5-e775badbfd07 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:45.962213 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-45035da7-697c-4877-8ed5-e775badbfd07 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:45.969203 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45035da7-697c-4877-8ed5-e775badbfd07 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:45.969644 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45035da7-697c-4877-8ed5-e775badbfd07 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:45.970398 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45035da7-697c-4877-8ed5-e775badbfd07 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:45.970866 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45035da7-697c-4877-8ed5-e775badbfd07 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:46.103987 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-45035da7-697c-4877-8ed5-e775badbfd07 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:46.111253 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-45035da7-697c-4877-8ed5-e775badbfd07 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.153596 Apr 05 11:18:46.111821 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 388/795] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:45 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:46.222995 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4df9a9c7-784b-47a2-9c35-d61602bf5834 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:46.223531 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4df9a9c7-784b-47a2-9c35-d61602bf5834 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:46.229797 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4df9a9c7-784b-47a2-9c35-d61602bf5834 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:46.230486 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4df9a9c7-784b-47a2-9c35-d61602bf5834 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:46.231020 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4df9a9c7-784b-47a2-9c35-d61602bf5834 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:46.231456 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4df9a9c7-784b-47a2-9c35-d61602bf5834 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:46.361024 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4df9a9c7-784b-47a2-9c35-d61602bf5834 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:46.369688 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4df9a9c7-784b-47a2-9c35-d61602bf5834 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:46.371268 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4df9a9c7-784b-47a2-9c35-d61602bf5834 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:46.372970 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4df9a9c7-784b-47a2-9c35-d61602bf5834 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.153485 Apr 05 11:18:46.373526 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 408/796] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:46 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:47.128696 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b0badc26-22a7-486a-8c10-1ebf3399f1ea tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:47.129304 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b0badc26-22a7-486a-8c10-1ebf3399f1ea tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:47.135741 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b0badc26-22a7-486a-8c10-1ebf3399f1ea tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:47.136194 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b0badc26-22a7-486a-8c10-1ebf3399f1ea tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:47.136959 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b0badc26-22a7-486a-8c10-1ebf3399f1ea tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:47.137395 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b0badc26-22a7-486a-8c10-1ebf3399f1ea tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:47.277610 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b0badc26-22a7-486a-8c10-1ebf3399f1ea tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:47.285890 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b0badc26-22a7-486a-8c10-1ebf3399f1ea tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.160942 Apr 05 11:18:47.295679 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 389/797] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:47 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:47.390304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6d244b3d-6c12-48cf-a83e-7a7672a65260 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:47.390860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6d244b3d-6c12-48cf-a83e-7a7672a65260 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:47.397656 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d244b3d-6c12-48cf-a83e-7a7672a65260 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:47.398104 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d244b3d-6c12-48cf-a83e-7a7672a65260 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:47.398963 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d244b3d-6c12-48cf-a83e-7a7672a65260 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:47.399397 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d244b3d-6c12-48cf-a83e-7a7672a65260 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:47.540037 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6d244b3d-6c12-48cf-a83e-7a7672a65260 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:47.548652 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6d244b3d-6c12-48cf-a83e-7a7672a65260 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:47.550145 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6d244b3d-6c12-48cf-a83e-7a7672a65260 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:47.551322 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6d244b3d-6c12-48cf-a83e-7a7672a65260 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.165075 Apr 05 11:18:47.551884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 409/798] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:47 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:48.302784 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b85928c5-4bd9-4fa3-a706-55400d0f441e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:48.303425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b85928c5-4bd9-4fa3-a706-55400d0f441e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:48.309731 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b85928c5-4bd9-4fa3-a706-55400d0f441e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:48.310842 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b85928c5-4bd9-4fa3-a706-55400d0f441e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:48.313626 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b85928c5-4bd9-4fa3-a706-55400d0f441e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:48.313626 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b85928c5-4bd9-4fa3-a706-55400d0f441e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:48.447463 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b85928c5-4bd9-4fa3-a706-55400d0f441e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:48.454738 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b85928c5-4bd9-4fa3-a706-55400d0f441e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.155881 Apr 05 11:18:48.455295 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 390/799] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:48 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:48.570421 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-936ff0c8-78d3-44f0-b58b-f66ee0451127 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:48.571134 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-936ff0c8-78d3-44f0-b58b-f66ee0451127 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:48.577500 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-936ff0c8-78d3-44f0-b58b-f66ee0451127 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:48.577942 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-936ff0c8-78d3-44f0-b58b-f66ee0451127 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:48.578794 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-936ff0c8-78d3-44f0-b58b-f66ee0451127 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:48.579230 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-936ff0c8-78d3-44f0-b58b-f66ee0451127 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:48.710881 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-936ff0c8-78d3-44f0-b58b-f66ee0451127 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:48.719753 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-936ff0c8-78d3-44f0-b58b-f66ee0451127 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:48.721345 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-936ff0c8-78d3-44f0-b58b-f66ee0451127 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:48.722581 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-936ff0c8-78d3-44f0-b58b-f66ee0451127 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.156512 Apr 05 11:18:48.723282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 410/800] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:48 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:49.471305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-848d7d27-cf12-4ca9-b077-8bc181088146 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:49.471928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-848d7d27-cf12-4ca9-b077-8bc181088146 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:49.478079 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-848d7d27-cf12-4ca9-b077-8bc181088146 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:49.478523 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-848d7d27-cf12-4ca9-b077-8bc181088146 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:49.479321 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-848d7d27-cf12-4ca9-b077-8bc181088146 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:49.479751 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-848d7d27-cf12-4ca9-b077-8bc181088146 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:49.612698 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-848d7d27-cf12-4ca9-b077-8bc181088146 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:49.620311 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-848d7d27-cf12-4ca9-b077-8bc181088146 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.152996 Apr 05 11:18:49.623778 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 391/801] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:49 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:49.741416 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f89a71a3-7c83-44cf-8230-a5df648cd54b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:49.742021 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f89a71a3-7c83-44cf-8230-a5df648cd54b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:49.748902 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f89a71a3-7c83-44cf-8230-a5df648cd54b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:49.749349 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f89a71a3-7c83-44cf-8230-a5df648cd54b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:49.750735 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f89a71a3-7c83-44cf-8230-a5df648cd54b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:49.751172 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f89a71a3-7c83-44cf-8230-a5df648cd54b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:49.881620 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f89a71a3-7c83-44cf-8230-a5df648cd54b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:49.889999 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f89a71a3-7c83-44cf-8230-a5df648cd54b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:49.891603 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f89a71a3-7c83-44cf-8230-a5df648cd54b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:49.892739 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f89a71a3-7c83-44cf-8230-a5df648cd54b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.155308 Apr 05 11:18:49.893298 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 411/802] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:49 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:50.639407 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-61de826b-ea43-4ed6-a484-ee72c9afddc1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:50.640018 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-61de826b-ea43-4ed6-a484-ee72c9afddc1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:50.647118 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-61de826b-ea43-4ed6-a484-ee72c9afddc1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:50.647595 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-61de826b-ea43-4ed6-a484-ee72c9afddc1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:50.648356 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-61de826b-ea43-4ed6-a484-ee72c9afddc1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:50.648786 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-61de826b-ea43-4ed6-a484-ee72c9afddc1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:50.780384 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-61de826b-ea43-4ed6-a484-ee72c9afddc1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:50.787602 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-61de826b-ea43-4ed6-a484-ee72c9afddc1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.152022 Apr 05 11:18:50.788167 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 392/803] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:50 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:50.911217 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-14745177-e19f-4752-8bbb-41914f664f82 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:50.911869 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-14745177-e19f-4752-8bbb-41914f664f82 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:50.918203 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-14745177-e19f-4752-8bbb-41914f664f82 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:50.918683 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-14745177-e19f-4752-8bbb-41914f664f82 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:50.919525 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-14745177-e19f-4752-8bbb-41914f664f82 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:50.920013 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-14745177-e19f-4752-8bbb-41914f664f82 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:51.054797 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-14745177-e19f-4752-8bbb-41914f664f82 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:51.063523 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-14745177-e19f-4752-8bbb-41914f664f82 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:51.065053 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-14745177-e19f-4752-8bbb-41914f664f82 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:51.066186 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-14745177-e19f-4752-8bbb-41914f664f82 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.158993 Apr 05 11:18:51.066779 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 412/804] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:50 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:51.804268 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eafd9773-f1da-4a42-ac48-daebfd8c24ef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:51.804882 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eafd9773-f1da-4a42-ac48-daebfd8c24ef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:51.811460 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eafd9773-f1da-4a42-ac48-daebfd8c24ef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:51.813769 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eafd9773-f1da-4a42-ac48-daebfd8c24ef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:51.813769 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eafd9773-f1da-4a42-ac48-daebfd8c24ef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:51.813769 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eafd9773-f1da-4a42-ac48-daebfd8c24ef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:51.949042 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eafd9773-f1da-4a42-ac48-daebfd8c24ef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:51.957006 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eafd9773-f1da-4a42-ac48-daebfd8c24ef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.156543 Apr 05 11:18:51.957582 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 393/805] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:51 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:52.084910 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d63e1d5a-ab38-482f-8d0a-cc8d071d398a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:52.085601 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d63e1d5a-ab38-482f-8d0a-cc8d071d398a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:52.091982 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d63e1d5a-ab38-482f-8d0a-cc8d071d398a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:52.092432 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d63e1d5a-ab38-482f-8d0a-cc8d071d398a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:52.093198 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d63e1d5a-ab38-482f-8d0a-cc8d071d398a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:52.093632 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d63e1d5a-ab38-482f-8d0a-cc8d071d398a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:52.225764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d63e1d5a-ab38-482f-8d0a-cc8d071d398a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:52.234525 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d63e1d5a-ab38-482f-8d0a-cc8d071d398a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:52.235554 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d63e1d5a-ab38-482f-8d0a-cc8d071d398a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:52.236682 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d63e1d5a-ab38-482f-8d0a-cc8d071d398a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.155699 Apr 05 11:18:52.237242 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 413/806] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:52 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:18:52.974233 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fc5d620f-e710-4c84-a07a-25704c8c31d3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:52.974785 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fc5d620f-e710-4c84-a07a-25704c8c31d3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:52.981072 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fc5d620f-e710-4c84-a07a-25704c8c31d3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:52.981518 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fc5d620f-e710-4c84-a07a-25704c8c31d3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:52.982275 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fc5d620f-e710-4c84-a07a-25704c8c31d3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:52.982758 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fc5d620f-e710-4c84-a07a-25704c8c31d3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:53.116035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fc5d620f-e710-4c84-a07a-25704c8c31d3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:53.123877 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fc5d620f-e710-4c84-a07a-25704c8c31d3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.154058 Apr 05 11:18:53.124453 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 394/807] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:52 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:53.254477 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-179cf955-1854-4cdc-9547-33fda0d5859c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:53.255215 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-179cf955-1854-4cdc-9547-33fda0d5859c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:53.261642 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-179cf955-1854-4cdc-9547-33fda0d5859c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:53.262097 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-179cf955-1854-4cdc-9547-33fda0d5859c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:53.262904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-179cf955-1854-4cdc-9547-33fda0d5859c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:53.263343 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-179cf955-1854-4cdc-9547-33fda0d5859c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:53.399284 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-179cf955-1854-4cdc-9547-33fda0d5859c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:53.407437 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-179cf955-1854-4cdc-9547-33fda0d5859c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:53.408930 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-179cf955-1854-4cdc-9547-33fda0d5859c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:53.410103 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-179cf955-1854-4cdc-9547-33fda0d5859c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.159724 Apr 05 11:18:53.411319 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 414/808] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:53 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:54.141096 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e130cd1c-0e67-4018-a955-4eaae8a82a2c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:54.141608 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e130cd1c-0e67-4018-a955-4eaae8a82a2c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:54.150646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e130cd1c-0e67-4018-a955-4eaae8a82a2c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:54.150646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e130cd1c-0e67-4018-a955-4eaae8a82a2c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:54.150646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e130cd1c-0e67-4018-a955-4eaae8a82a2c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:54.150646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e130cd1c-0e67-4018-a955-4eaae8a82a2c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:54.293964 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e130cd1c-0e67-4018-a955-4eaae8a82a2c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:54.301999 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e130cd1c-0e67-4018-a955-4eaae8a82a2c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.164918 Apr 05 11:18:54.302777 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 395/809] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:54 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:54.429451 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ec9dc415-dadb-40a8-ac61-2237c96ae195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:54.429967 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ec9dc415-dadb-40a8-ac61-2237c96ae195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:54.436206 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec9dc415-dadb-40a8-ac61-2237c96ae195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:54.436648 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec9dc415-dadb-40a8-ac61-2237c96ae195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:54.437403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec9dc415-dadb-40a8-ac61-2237c96ae195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:54.437837 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec9dc415-dadb-40a8-ac61-2237c96ae195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:54.567568 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ec9dc415-dadb-40a8-ac61-2237c96ae195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:54.575762 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ec9dc415-dadb-40a8-ac61-2237c96ae195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:54.577260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ec9dc415-dadb-40a8-ac61-2237c96ae195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:54.578455 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ec9dc415-dadb-40a8-ac61-2237c96ae195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.153519 Apr 05 11:18:54.579065 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 415/810] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:54 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:55.319691 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d082c538-4370-458a-93d5-ec5b98ebb1da tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:55.320302 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d082c538-4370-458a-93d5-ec5b98ebb1da tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:55.326873 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d082c538-4370-458a-93d5-ec5b98ebb1da tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:55.327331 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d082c538-4370-458a-93d5-ec5b98ebb1da tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:55.328097 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d082c538-4370-458a-93d5-ec5b98ebb1da tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:55.328535 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d082c538-4370-458a-93d5-ec5b98ebb1da tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:55.464979 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d082c538-4370-458a-93d5-ec5b98ebb1da tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:55.472353 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d082c538-4370-458a-93d5-ec5b98ebb1da tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.157081 Apr 05 11:18:55.472931 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 396/811] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:55 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:55.596790 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5f4cd1f2-adb3-4e40-a716-1cc6e1fb8f97 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:55.597344 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5f4cd1f2-adb3-4e40-a716-1cc6e1fb8f97 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:55.603794 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5f4cd1f2-adb3-4e40-a716-1cc6e1fb8f97 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:55.604262 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5f4cd1f2-adb3-4e40-a716-1cc6e1fb8f97 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:55.605044 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5f4cd1f2-adb3-4e40-a716-1cc6e1fb8f97 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:55.605548 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5f4cd1f2-adb3-4e40-a716-1cc6e1fb8f97 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:55.739296 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5f4cd1f2-adb3-4e40-a716-1cc6e1fb8f97 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:55.747824 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5f4cd1f2-adb3-4e40-a716-1cc6e1fb8f97 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:55.749318 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5f4cd1f2-adb3-4e40-a716-1cc6e1fb8f97 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:55.750461 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5f4cd1f2-adb3-4e40-a716-1cc6e1fb8f97 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.157760 Apr 05 11:18:55.751072 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 416/812] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:55 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:56.489069 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ae91767c-821f-4fa3-8b25-8fd24258d00c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:56.489730 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ae91767c-821f-4fa3-8b25-8fd24258d00c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:56.496215 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae91767c-821f-4fa3-8b25-8fd24258d00c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:56.496662 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae91767c-821f-4fa3-8b25-8fd24258d00c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:56.497412 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae91767c-821f-4fa3-8b25-8fd24258d00c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:56.497837 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae91767c-821f-4fa3-8b25-8fd24258d00c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:56.630005 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ae91767c-821f-4fa3-8b25-8fd24258d00c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:56.637257 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ae91767c-821f-4fa3-8b25-8fd24258d00c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1260 microversion: 2.1 time: 0.151961 Apr 05 11:18:56.637810 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 397/813] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:56 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:56.769200 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef1f8ec7-cda8-4f5f-b079-aa4f70a495f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:56.769909 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ef1f8ec7-cda8-4f5f-b079-aa4f70a495f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:56.776846 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef1f8ec7-cda8-4f5f-b079-aa4f70a495f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:56.779971 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef1f8ec7-cda8-4f5f-b079-aa4f70a495f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:56.779971 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef1f8ec7-cda8-4f5f-b079-aa4f70a495f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:56.779971 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef1f8ec7-cda8-4f5f-b079-aa4f70a495f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:56.911972 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef1f8ec7-cda8-4f5f-b079-aa4f70a495f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:56.920583 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef1f8ec7-cda8-4f5f-b079-aa4f70a495f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:56.922145 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef1f8ec7-cda8-4f5f-b079-aa4f70a495f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:56.923333 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ef1f8ec7-cda8-4f5f-b079-aa4f70a495f8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.158123 Apr 05 11:18:56.923902 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 417/814] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:56 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:18:57.654302 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-08b0bcb8-6531-4864-ade9-b2ea00f41979 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:57.654895 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-08b0bcb8-6531-4864-ade9-b2ea00f41979 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:57.662001 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08b0bcb8-6531-4864-ade9-b2ea00f41979 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:57.662545 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08b0bcb8-6531-4864-ade9-b2ea00f41979 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:57.663356 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08b0bcb8-6531-4864-ade9-b2ea00f41979 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:57.663794 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08b0bcb8-6531-4864-ade9-b2ea00f41979 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:57.800472 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-08b0bcb8-6531-4864-ade9-b2ea00f41979 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:57.808090 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-08b0bcb8-6531-4864-ade9-b2ea00f41979 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1444 microversion: 2.1 time: 0.157740 Apr 05 11:18:57.808709 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 398/815] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:57 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:57.824534 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e64b5d5c-0fdd-4cce-8655-b6e81874a1f0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:57.825130 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e64b5d5c-0fdd-4cce-8655-b6e81874a1f0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:57.831362 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e64b5d5c-0fdd-4cce-8655-b6e81874a1f0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:57.831811 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e64b5d5c-0fdd-4cce-8655-b6e81874a1f0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:57.832564 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e64b5d5c-0fdd-4cce-8655-b6e81874a1f0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:57.833494 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e64b5d5c-0fdd-4cce-8655-b6e81874a1f0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:57.941508 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f98d8797-2272-43e7-aa66-25f115d3bf80 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:57.942118 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f98d8797-2272-43e7-aa66-25f115d3bf80 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:57.948040 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f98d8797-2272-43e7-aa66-25f115d3bf80 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:57.948494 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f98d8797-2272-43e7-aa66-25f115d3bf80 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:57.949277 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f98d8797-2272-43e7-aa66-25f115d3bf80 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:57.949715 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f98d8797-2272-43e7-aa66-25f115d3bf80 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:57.969340 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e64b5d5c-0fdd-4cce-8655-b6e81874a1f0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:57.978333 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e64b5d5c-0fdd-4cce-8655-b6e81874a1f0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1444 microversion: 2.1 time: 0.157486 Apr 05 11:18:57.979250 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 418/816] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:18:57 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:18:58.084590 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f98d8797-2272-43e7-aa66-25f115d3bf80 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:58.093002 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f98d8797-2272-43e7-aa66-25f115d3bf80 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:58.094505 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f98d8797-2272-43e7-aa66-25f115d3bf80 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:58.095675 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f98d8797-2272-43e7-aa66-25f115d3bf80 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.158284 Apr 05 11:18:58.096223 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 399/817] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:57 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:18:59.113462 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6ccd38f6-f9d2-4c66-8a49-fcaba550b20d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:18:59.114101 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6ccd38f6-f9d2-4c66-8a49-fcaba550b20d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:18:59.120812 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6ccd38f6-f9d2-4c66-8a49-fcaba550b20d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:59.121277 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6ccd38f6-f9d2-4c66-8a49-fcaba550b20d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:59.122038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6ccd38f6-f9d2-4c66-8a49-fcaba550b20d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:18:59.122467 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6ccd38f6-f9d2-4c66-8a49-fcaba550b20d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:18:59.356308 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6ccd38f6-f9d2-4c66-8a49-fcaba550b20d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:59.365397 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6ccd38f6-f9d2-4c66-8a49-fcaba550b20d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:59.366946 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6ccd38f6-f9d2-4c66-8a49-fcaba550b20d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:18:59.368392 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6ccd38f6-f9d2-4c66-8a49-fcaba550b20d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.258794 Apr 05 11:18:59.368984 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 419/818] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:18:59 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:00.303327 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-b69e151f-a2a7-4e7c-b15f-cfb96a5671b1 req-a0ab828b-597c-42e6-8db0-ac1d98e5b751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4e16432-3df3-4325-b757-906fbbeca604", "tag": "dc377578-0184-4a80-88e0-2385eab5c0c4"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:19:00.311206 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-b69e151f-a2a7-4e7c-b15f-cfb96a5671b1 req-a0ab828b-597c-42e6-8db0-ac1d98e5b751 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:00.311671 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-b69e151f-a2a7-4e7c-b15f-cfb96a5671b1 req-a0ab828b-597c-42e6-8db0-ac1d98e5b751 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:00.323056 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-b69e151f-a2a7-4e7c-b15f-cfb96a5671b1 req-a0ab828b-597c-42e6-8db0-ac1d98e5b751 service nova] Creating event network-changed:dc377578-0184-4a80-88e0-2385eab5c0c4 for instance e4e16432-3df3-4325-b757-906fbbeca604 on hv-cinder-81899 Apr 05 11:19:00.328361 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-b69e151f-a2a7-4e7c-b15f-cfb96a5671b1 req-a0ab828b-597c-42e6-8db0-ac1d98e5b751 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155900 Apr 05 11:19:00.328962 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 400/819] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:19:00.387456 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-51dbcd2b-00fd-4f54-8988-174b23160a1a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:00.388067 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-51dbcd2b-00fd-4f54-8988-174b23160a1a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:00.394300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51dbcd2b-00fd-4f54-8988-174b23160a1a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:00.394794 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51dbcd2b-00fd-4f54-8988-174b23160a1a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:00.396147 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51dbcd2b-00fd-4f54-8988-174b23160a1a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:00.396584 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51dbcd2b-00fd-4f54-8988-174b23160a1a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:00.536089 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-51dbcd2b-00fd-4f54-8988-174b23160a1a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:00.544417 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-51dbcd2b-00fd-4f54-8988-174b23160a1a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:00.546084 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-51dbcd2b-00fd-4f54-8988-174b23160a1a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:00.551319 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-51dbcd2b-00fd-4f54-8988-174b23160a1a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.164017 Apr 05 11:19:00.551319 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 420/820] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:00 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:01.565885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-32c0696c-320b-4dad-b748-517657a91b20 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:01.566625 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-32c0696c-320b-4dad-b748-517657a91b20 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:01.573229 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-32c0696c-320b-4dad-b748-517657a91b20 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:01.573681 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-32c0696c-320b-4dad-b748-517657a91b20 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:01.574449 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-32c0696c-320b-4dad-b748-517657a91b20 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:01.574949 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-32c0696c-320b-4dad-b748-517657a91b20 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:01.710772 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-32c0696c-320b-4dad-b748-517657a91b20 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:01.719016 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-32c0696c-320b-4dad-b748-517657a91b20 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:01.720584 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-32c0696c-320b-4dad-b748-517657a91b20 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:01.721725 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-32c0696c-320b-4dad-b748-517657a91b20 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.160211 Apr 05 11:19:01.722284 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 401/821] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:01 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:02.741101 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4467e66a-9b8c-4af6-a3b9-f6b657ea7d83 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:02.741698 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4467e66a-9b8c-4af6-a3b9-f6b657ea7d83 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:02.748347 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4467e66a-9b8c-4af6-a3b9-f6b657ea7d83 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:02.748799 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4467e66a-9b8c-4af6-a3b9-f6b657ea7d83 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:02.749561 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4467e66a-9b8c-4af6-a3b9-f6b657ea7d83 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:02.749999 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4467e66a-9b8c-4af6-a3b9-f6b657ea7d83 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:02.885250 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4467e66a-9b8c-4af6-a3b9-f6b657ea7d83 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:02.894112 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4467e66a-9b8c-4af6-a3b9-f6b657ea7d83 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:02.895646 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4467e66a-9b8c-4af6-a3b9-f6b657ea7d83 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:02.897927 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4467e66a-9b8c-4af6-a3b9-f6b657ea7d83 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.161474 Apr 05 11:19:02.898542 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 421/822] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:02 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:03.917129 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5ef3247e-7c35-45b3-beb3-13bee3146544 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:03.917742 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5ef3247e-7c35-45b3-beb3-13bee3146544 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:03.924182 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5ef3247e-7c35-45b3-beb3-13bee3146544 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:03.924636 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5ef3247e-7c35-45b3-beb3-13bee3146544 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:03.925405 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5ef3247e-7c35-45b3-beb3-13bee3146544 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:03.925842 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5ef3247e-7c35-45b3-beb3-13bee3146544 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:04.061022 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5ef3247e-7c35-45b3-beb3-13bee3146544 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:04.070310 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5ef3247e-7c35-45b3-beb3-13bee3146544 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:04.071868 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5ef3247e-7c35-45b3-beb3-13bee3146544 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:04.073024 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5ef3247e-7c35-45b3-beb3-13bee3146544 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.159776 Apr 05 11:19:04.073772 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 402/823] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:03 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:05.091635 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6920b716-1123-4f3d-a0c4-b5825c4a4b47 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:05.092197 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6920b716-1123-4f3d-a0c4-b5825c4a4b47 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:05.098400 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6920b716-1123-4f3d-a0c4-b5825c4a4b47 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:05.098885 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6920b716-1123-4f3d-a0c4-b5825c4a4b47 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:05.100149 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6920b716-1123-4f3d-a0c4-b5825c4a4b47 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:05.100586 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6920b716-1123-4f3d-a0c4-b5825c4a4b47 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:05.233686 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6920b716-1123-4f3d-a0c4-b5825c4a4b47 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:05.242206 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6920b716-1123-4f3d-a0c4-b5825c4a4b47 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:05.244008 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6920b716-1123-4f3d-a0c4-b5825c4a4b47 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:05.245250 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6920b716-1123-4f3d-a0c4-b5825c4a4b47 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.157670 Apr 05 11:19:05.245843 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 422/824] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:05 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:06.264712 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c45638e6-6b0a-49b7-98a2-4c6558d74cc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:06.265667 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c45638e6-6b0a-49b7-98a2-4c6558d74cc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:06.272403 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c45638e6-6b0a-49b7-98a2-4c6558d74cc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:06.272855 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c45638e6-6b0a-49b7-98a2-4c6558d74cc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:06.273619 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c45638e6-6b0a-49b7-98a2-4c6558d74cc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:06.274048 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c45638e6-6b0a-49b7-98a2-4c6558d74cc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:06.410732 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c45638e6-6b0a-49b7-98a2-4c6558d74cc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:06.419609 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c45638e6-6b0a-49b7-98a2-4c6558d74cc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:06.421126 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c45638e6-6b0a-49b7-98a2-4c6558d74cc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:06.422278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c45638e6-6b0a-49b7-98a2-4c6558d74cc9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.161883 Apr 05 11:19:06.422866 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 403/825] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:06 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:19:07.440838 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e88bf5f1-085e-4afd-a235-f3421c5ee964 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:07.441450 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e88bf5f1-085e-4afd-a235-f3421c5ee964 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:07.448419 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e88bf5f1-085e-4afd-a235-f3421c5ee964 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:07.454356 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e88bf5f1-085e-4afd-a235-f3421c5ee964 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:07.454356 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e88bf5f1-085e-4afd-a235-f3421c5ee964 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:07.454356 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e88bf5f1-085e-4afd-a235-f3421c5ee964 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:07.591546 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e88bf5f1-085e-4afd-a235-f3421c5ee964 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:07.600161 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e88bf5f1-085e-4afd-a235-f3421c5ee964 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:07.601709 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e88bf5f1-085e-4afd-a235-f3421c5ee964 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:07.602941 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e88bf5f1-085e-4afd-a235-f3421c5ee964 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.165963 Apr 05 11:19:07.603498 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 423/826] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:07 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:08.216772 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-775939b4-e01f-43fc-8185-6356e0eb0662 req-bd83b187-ca15-474e-b11e-e235f245ab53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c900362d-904b-4d64-a9a3-ab381ca756e3", "name": "network-vif-plugged", "status": "completed", "tag": "be14224c-0258-4dc2-9ce4-f41347c20fc0"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:19:08.224032 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-775939b4-e01f-43fc-8185-6356e0eb0662 req-bd83b187-ca15-474e-b11e-e235f245ab53 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:08.224478 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-775939b4-e01f-43fc-8185-6356e0eb0662 req-bd83b187-ca15-474e-b11e-e235f245ab53 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:08.236117 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-775939b4-e01f-43fc-8185-6356e0eb0662 req-bd83b187-ca15-474e-b11e-e235f245ab53 service nova] Creating event network-vif-plugged:be14224c-0258-4dc2-9ce4-f41347c20fc0 for instance c900362d-904b-4d64-a9a3-ab381ca756e3 on hv-cinder-81899 Apr 05 11:19:08.242537 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-775939b4-e01f-43fc-8185-6356e0eb0662 req-bd83b187-ca15-474e-b11e-e235f245ab53 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082223 Apr 05 11:19:08.242537 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 404/827] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:19:08.621907 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9bbd987e-c987-4038-ae5a-8f62bb72ecb5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:08.633504 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9bbd987e-c987-4038-ae5a-8f62bb72ecb5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:08.633504 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9bbd987e-c987-4038-ae5a-8f62bb72ecb5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:08.633504 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9bbd987e-c987-4038-ae5a-8f62bb72ecb5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:08.633504 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9bbd987e-c987-4038-ae5a-8f62bb72ecb5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:08.634378 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9bbd987e-c987-4038-ae5a-8f62bb72ecb5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:08.768970 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9bbd987e-c987-4038-ae5a-8f62bb72ecb5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:08.778166 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9bbd987e-c987-4038-ae5a-8f62bb72ecb5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:08.779727 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9bbd987e-c987-4038-ae5a-8f62bb72ecb5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:08.780871 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9bbd987e-c987-4038-ae5a-8f62bb72ecb5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.162935 Apr 05 11:19:08.781431 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 424/828] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:08 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:09.800341 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6bdfb076-f1fd-4e81-ad93-aaa1ff602abd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:09.800984 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6bdfb076-f1fd-4e81-ad93-aaa1ff602abd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:09.807155 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6bdfb076-f1fd-4e81-ad93-aaa1ff602abd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:09.807601 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6bdfb076-f1fd-4e81-ad93-aaa1ff602abd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:09.808371 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6bdfb076-f1fd-4e81-ad93-aaa1ff602abd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:09.808806 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6bdfb076-f1fd-4e81-ad93-aaa1ff602abd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:09.944289 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6bdfb076-f1fd-4e81-ad93-aaa1ff602abd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:09.952633 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6bdfb076-f1fd-4e81-ad93-aaa1ff602abd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:09.954220 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6bdfb076-f1fd-4e81-ad93-aaa1ff602abd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:09.955405 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6bdfb076-f1fd-4e81-ad93-aaa1ff602abd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.159871 Apr 05 11:19:09.955971 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 405/829] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:09 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:10.974310 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ede0f29a-1cae-4afb-bb61-8346daa5527d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:10.975024 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ede0f29a-1cae-4afb-bb61-8346daa5527d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:10.981915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ede0f29a-1cae-4afb-bb61-8346daa5527d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:10.982368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ede0f29a-1cae-4afb-bb61-8346daa5527d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:10.983169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ede0f29a-1cae-4afb-bb61-8346daa5527d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:10.983607 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ede0f29a-1cae-4afb-bb61-8346daa5527d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:11.120292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ede0f29a-1cae-4afb-bb61-8346daa5527d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:11.128542 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ede0f29a-1cae-4afb-bb61-8346daa5527d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:11.130083 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ede0f29a-1cae-4afb-bb61-8346daa5527d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:11.131254 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ede0f29a-1cae-4afb-bb61-8346daa5527d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.160964 Apr 05 11:19:11.131817 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 425/830] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:10 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:12.149351 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c601e51a-1482-487c-a7e4-c6ee9da5508c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:12.149943 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c601e51a-1482-487c-a7e4-c6ee9da5508c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:12.156357 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c601e51a-1482-487c-a7e4-c6ee9da5508c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:12.156834 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c601e51a-1482-487c-a7e4-c6ee9da5508c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:12.157598 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c601e51a-1482-487c-a7e4-c6ee9da5508c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:12.158025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c601e51a-1482-487c-a7e4-c6ee9da5508c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:12.293691 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c601e51a-1482-487c-a7e4-c6ee9da5508c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:12.301911 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c601e51a-1482-487c-a7e4-c6ee9da5508c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:12.303449 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c601e51a-1482-487c-a7e4-c6ee9da5508c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:12.305516 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c601e51a-1482-487c-a7e4-c6ee9da5508c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.160087 Apr 05 11:19:12.306083 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 406/831] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:12 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:13.324318 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e3691e00-6e7c-4004-a9eb-8a4e1fd78461 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:13.324833 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e3691e00-6e7c-4004-a9eb-8a4e1fd78461 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:13.331312 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e3691e00-6e7c-4004-a9eb-8a4e1fd78461 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:13.331760 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e3691e00-6e7c-4004-a9eb-8a4e1fd78461 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:13.332517 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e3691e00-6e7c-4004-a9eb-8a4e1fd78461 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:13.332946 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e3691e00-6e7c-4004-a9eb-8a4e1fd78461 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:13.462492 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e3691e00-6e7c-4004-a9eb-8a4e1fd78461 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:13.470764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e3691e00-6e7c-4004-a9eb-8a4e1fd78461 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:13.472274 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e3691e00-6e7c-4004-a9eb-8a4e1fd78461 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:13.473433 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e3691e00-6e7c-4004-a9eb-8a4e1fd78461 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.153721 Apr 05 11:19:13.473999 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 426/832] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:13 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:14.491870 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2d13aee1-d8e5-4c8f-9d27-da7f553cb05d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:14.492791 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2d13aee1-d8e5-4c8f-9d27-da7f553cb05d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:14.499966 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d13aee1-d8e5-4c8f-9d27-da7f553cb05d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:14.500758 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d13aee1-d8e5-4c8f-9d27-da7f553cb05d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:14.501251 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d13aee1-d8e5-4c8f-9d27-da7f553cb05d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:14.501719 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d13aee1-d8e5-4c8f-9d27-da7f553cb05d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:14.633143 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2d13aee1-d8e5-4c8f-9d27-da7f553cb05d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:14.641737 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2d13aee1-d8e5-4c8f-9d27-da7f553cb05d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:14.643260 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2d13aee1-d8e5-4c8f-9d27-da7f553cb05d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:14.644551 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2d13aee1-d8e5-4c8f-9d27-da7f553cb05d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.156780 Apr 05 11:19:14.645110 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 407/833] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:14 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:19:15.663188 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-338be191-fbc4-40a3-8880-9582f63e802c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:15.663790 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-338be191-fbc4-40a3-8880-9582f63e802c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:15.670778 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-338be191-fbc4-40a3-8880-9582f63e802c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:15.671222 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-338be191-fbc4-40a3-8880-9582f63e802c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:15.671978 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-338be191-fbc4-40a3-8880-9582f63e802c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:15.672406 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-338be191-fbc4-40a3-8880-9582f63e802c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:15.816267 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-338be191-fbc4-40a3-8880-9582f63e802c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:15.816267 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-338be191-fbc4-40a3-8880-9582f63e802c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:15.817775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-338be191-fbc4-40a3-8880-9582f63e802c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:15.818936 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-338be191-fbc4-40a3-8880-9582f63e802c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.159611 Apr 05 11:19:15.819499 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 427/834] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:15 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:16.837605 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-09903e98-c69a-418b-968d-156a2c9a2978 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:16.838253 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-09903e98-c69a-418b-968d-156a2c9a2978 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:16.844610 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09903e98-c69a-418b-968d-156a2c9a2978 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:16.845057 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09903e98-c69a-418b-968d-156a2c9a2978 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:16.845816 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09903e98-c69a-418b-968d-156a2c9a2978 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:16.846252 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09903e98-c69a-418b-968d-156a2c9a2978 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:16.982140 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-09903e98-c69a-418b-968d-156a2c9a2978 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:16.990429 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-09903e98-c69a-418b-968d-156a2c9a2978 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:16.992214 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-09903e98-c69a-418b-968d-156a2c9a2978 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:16.993366 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-09903e98-c69a-418b-968d-156a2c9a2978 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.159956 Apr 05 11:19:16.993928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 408/835] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:16 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:18.012104 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-df306a4a-be4e-4a7f-8e6f-169fe3b52c23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:18.013882 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-df306a4a-be4e-4a7f-8e6f-169fe3b52c23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:18.018568 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df306a4a-be4e-4a7f-8e6f-169fe3b52c23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:18.019055 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df306a4a-be4e-4a7f-8e6f-169fe3b52c23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:18.019815 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df306a4a-be4e-4a7f-8e6f-169fe3b52c23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:18.020254 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df306a4a-be4e-4a7f-8e6f-169fe3b52c23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:18.153087 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-df306a4a-be4e-4a7f-8e6f-169fe3b52c23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:18.161400 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-df306a4a-be4e-4a7f-8e6f-169fe3b52c23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:18.162929 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-df306a4a-be4e-4a7f-8e6f-169fe3b52c23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:18.164081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-df306a4a-be4e-4a7f-8e6f-169fe3b52c23 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.156052 Apr 05 11:19:18.164667 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 428/836] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:18 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:19.183481 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-41b1efd2-733b-4fd8-b8ab-95b24bb3a89a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:19.184189 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-41b1efd2-733b-4fd8-b8ab-95b24bb3a89a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:19.191234 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41b1efd2-733b-4fd8-b8ab-95b24bb3a89a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:19.191688 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41b1efd2-733b-4fd8-b8ab-95b24bb3a89a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:19.192456 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41b1efd2-733b-4fd8-b8ab-95b24bb3a89a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:19.192899 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41b1efd2-733b-4fd8-b8ab-95b24bb3a89a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:19.325296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-41b1efd2-733b-4fd8-b8ab-95b24bb3a89a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:19.333460 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-41b1efd2-733b-4fd8-b8ab-95b24bb3a89a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:19.335035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-41b1efd2-733b-4fd8-b8ab-95b24bb3a89a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:19.336192 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-41b1efd2-733b-4fd8-b8ab-95b24bb3a89a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.157463 Apr 05 11:19:19.336740 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 409/837] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:19 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:20.355362 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a3fe5b9a-f18f-4bd2-bcea-e4395cedfb6f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:20.355961 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a3fe5b9a-f18f-4bd2-bcea-e4395cedfb6f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:20.362736 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3fe5b9a-f18f-4bd2-bcea-e4395cedfb6f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:20.363181 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3fe5b9a-f18f-4bd2-bcea-e4395cedfb6f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:20.363934 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3fe5b9a-f18f-4bd2-bcea-e4395cedfb6f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:20.364362 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3fe5b9a-f18f-4bd2-bcea-e4395cedfb6f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:20.499595 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a3fe5b9a-f18f-4bd2-bcea-e4395cedfb6f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:20.507930 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a3fe5b9a-f18f-4bd2-bcea-e4395cedfb6f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:20.509424 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a3fe5b9a-f18f-4bd2-bcea-e4395cedfb6f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:20.510566 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a3fe5b9a-f18f-4bd2-bcea-e4395cedfb6f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.159368 Apr 05 11:19:20.511155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 429/838] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:20 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:21.528385 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-18933e09-a6f3-4353-a6dc-183d956f7b46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:21.529007 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-18933e09-a6f3-4353-a6dc-183d956f7b46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:21.535318 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-18933e09-a6f3-4353-a6dc-183d956f7b46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:21.535772 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-18933e09-a6f3-4353-a6dc-183d956f7b46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:21.536540 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-18933e09-a6f3-4353-a6dc-183d956f7b46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:21.536982 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-18933e09-a6f3-4353-a6dc-183d956f7b46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:21.667136 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-18933e09-a6f3-4353-a6dc-183d956f7b46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:21.675539 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-18933e09-a6f3-4353-a6dc-183d956f7b46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:21.677083 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-18933e09-a6f3-4353-a6dc-183d956f7b46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:21.678275 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-18933e09-a6f3-4353-a6dc-183d956f7b46 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1811 microversion: 2.20 time: 0.153836 Apr 05 11:19:21.678884 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 410/839] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:21 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:22.697511 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a4556d57-605a-4456-8ac2-084bfd8de453 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:22.698128 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a4556d57-605a-4456-8ac2-084bfd8de453 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:22.704956 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a4556d57-605a-4456-8ac2-084bfd8de453 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:22.705402 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a4556d57-605a-4456-8ac2-084bfd8de453 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:22.706163 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a4556d57-605a-4456-8ac2-084bfd8de453 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:22.706998 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a4556d57-605a-4456-8ac2-084bfd8de453 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:22.836838 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a4556d57-605a-4456-8ac2-084bfd8de453 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:22.846661 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a4556d57-605a-4456-8ac2-084bfd8de453 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:22.848173 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a4556d57-605a-4456-8ac2-084bfd8de453 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:22.849355 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a4556d57-605a-4456-8ac2-084bfd8de453 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1798 microversion: 2.20 time: 0.155899 Apr 05 11:19:22.850007 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 430/840] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:19:22 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1798 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:19:27.464563 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4c130d00-0ab0-4926-82c0-448e2a152f89 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:27.469137 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4c130d00-0ab0-4926-82c0-448e2a152f89 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:27.471774 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c130d00-0ab0-4926-82c0-448e2a152f89 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:27.472219 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c130d00-0ab0-4926-82c0-448e2a152f89 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:27.472978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c130d00-0ab0-4926-82c0-448e2a152f89 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:27.473409 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c130d00-0ab0-4926-82c0-448e2a152f89 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:27.598727 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-4c130d00-0ab0-4926-82c0-448e2a152f89 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lazy-loading 'services' on Instance uuid ce13b8dc-7708-416a-b29b-d5cac40ad1a3 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:19:27.902844 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4c130d00-0ab0-4926-82c0-448e2a152f89 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3/os-volume_attachments/f0694799-ac94-4fde-bcd5-c807f34f3813" status: 202 len: 0 microversion: 2.1 time: 0.441898 Apr 05 11:19:27.903369 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 411/841] 10.222.0.39 () {58 vars in 1415 bytes} [Tue Apr 5 11:19:27 2022] DELETE /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3/os-volume_attachments/f0694799-ac94-4fde-bcd5-c807f34f3813 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:19:30.068292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c5bd4729-8e83-4f28-aee1-b6766dd68815 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:30.068796 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c5bd4729-8e83-4f28-aee1-b6766dd68815 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:30.075254 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c5bd4729-8e83-4f28-aee1-b6766dd68815 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:30.075701 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c5bd4729-8e83-4f28-aee1-b6766dd68815 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:30.076463 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c5bd4729-8e83-4f28-aee1-b6766dd68815 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:30.077538 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c5bd4729-8e83-4f28-aee1-b6766dd68815 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:30.100365 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c5bd4729-8e83-4f28-aee1-b6766dd68815 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:19:30.572400 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c5bd4729-8e83-4f28-aee1-b6766dd68815 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 204 len: 0 microversion: 2.1 time: 0.507552 Apr 05 11:19:30.572926 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 431/842] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:19:30 2022] DELETE /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:19:30.582425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8b52cb47-1bc4-4568-a8e0-312ef7a7577b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:30.583145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8b52cb47-1bc4-4568-a8e0-312ef7a7577b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:30.589549 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8b52cb47-1bc4-4568-a8e0-312ef7a7577b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:30.590006 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8b52cb47-1bc4-4568-a8e0-312ef7a7577b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:30.590888 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8b52cb47-1bc4-4568-a8e0-312ef7a7577b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:30.591323 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8b52cb47-1bc4-4568-a8e0-312ef7a7577b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:30.730133 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8b52cb47-1bc4-4568-a8e0-312ef7a7577b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:30.737851 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8b52cb47-1bc4-4568-a8e0-312ef7a7577b tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1513 microversion: 2.1 time: 0.160376 Apr 05 11:19:30.738416 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 412/843] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:19:30 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:19:31.756639 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-02bac064-0b8d-41d8-b9f1-dd31c19ce9b9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:31.757355 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-02bac064-0b8d-41d8-b9f1-dd31c19ce9b9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:31.763575 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-02bac064-0b8d-41d8-b9f1-dd31c19ce9b9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:31.764067 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-02bac064-0b8d-41d8-b9f1-dd31c19ce9b9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:31.764827 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-02bac064-0b8d-41d8-b9f1-dd31c19ce9b9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:31.765260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-02bac064-0b8d-41d8-b9f1-dd31c19ce9b9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:31.900150 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-02bac064-0b8d-41d8-b9f1-dd31c19ce9b9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:31.908965 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-02bac064-0b8d-41d8-b9f1-dd31c19ce9b9 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1513 microversion: 2.1 time: 0.156979 Apr 05 11:19:31.915165 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 432/844] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:19:31 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:19:32.925752 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f3b5133e-45d3-4502-ad43-4501f096046e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:32.926343 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f3b5133e-45d3-4502-ad43-4501f096046e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:32.932541 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f3b5133e-45d3-4502-ad43-4501f096046e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:32.932984 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f3b5133e-45d3-4502-ad43-4501f096046e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:32.933739 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f3b5133e-45d3-4502-ad43-4501f096046e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:32.934165 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f3b5133e-45d3-4502-ad43-4501f096046e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:33.069278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f3b5133e-45d3-4502-ad43-4501f096046e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:33.076493 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f3b5133e-45d3-4502-ad43-4501f096046e tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1513 microversion: 2.1 time: 0.155069 Apr 05 11:19:33.077058 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 413/845] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:19:32 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:19:33.649525 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-029cfc92-bb04-4b96-8d1f-a04f82c941c9 req-86b71272-fa28-4ff5-97a1-a5c720e68001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce13b8dc-7708-416a-b29b-d5cac40ad1a3", "name": "network-vif-deleted", "tag": "103701da-a5c4-43b6-8514-24a0767fa475"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:19:33.658551 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-029cfc92-bb04-4b96-8d1f-a04f82c941c9 req-86b71272-fa28-4ff5-97a1-a5c720e68001 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:33.659680 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-029cfc92-bb04-4b96-8d1f-a04f82c941c9 req-86b71272-fa28-4ff5-97a1-a5c720e68001 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:33.669572 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-029cfc92-bb04-4b96-8d1f-a04f82c941c9 req-86b71272-fa28-4ff5-97a1-a5c720e68001 service nova] Creating event network-vif-deleted:103701da-a5c4-43b6-8514-24a0767fa475 for instance ce13b8dc-7708-416a-b29b-d5cac40ad1a3 on hv-cinder-81899 Apr 05 11:19:33.674523 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-029cfc92-bb04-4b96-8d1f-a04f82c941c9 req-86b71272-fa28-4ff5-97a1-a5c720e68001 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028663 Apr 05 11:19:33.675163 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 433/846] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:19:34.093254 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a23027b6-db6a-44cf-9546-6fe56ef8890c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:34.093859 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a23027b6-db6a-44cf-9546-6fe56ef8890c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:34.100258 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a23027b6-db6a-44cf-9546-6fe56ef8890c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:34.100711 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a23027b6-db6a-44cf-9546-6fe56ef8890c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:34.101531 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a23027b6-db6a-44cf-9546-6fe56ef8890c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:34.101964 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a23027b6-db6a-44cf-9546-6fe56ef8890c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:34.134789 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a23027b6-db6a-44cf-9546-6fe56ef8890c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:34.135239 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a23027b6-db6a-44cf-9546-6fe56ef8890c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:34.135687 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-a23027b6-db6a-44cf-9546-6fe56ef8890c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lazy-loading 'fault' on Instance uuid ce13b8dc-7708-416a-b29b-d5cac40ad1a3 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:19:34.178301 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a23027b6-db6a-44cf-9546-6fe56ef8890c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b660172403d4aadb143c04913dede54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf76b11857e84565b9d171a41d7a3722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:34.185670 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a23027b6-db6a-44cf-9546-6fe56ef8890c tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 200 len: 1309 microversion: 2.1 time: 0.096299 Apr 05 11:19:34.186247 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 414/847] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:19:34 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:19:35.204788 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-44078b8d-3adc-49a1-8728-99e3604f6836 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:35.205474 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-44078b8d-3adc-49a1-8728-99e3604f6836 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] [instance: ce13b8dc-7708-416a-b29b-d5cac40ad1a3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:35.211771 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-44078b8d-3adc-49a1-8728-99e3604f6836 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:35.212218 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-44078b8d-3adc-49a1-8728-99e3604f6836 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:35.212981 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-44078b8d-3adc-49a1-8728-99e3604f6836 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:35.213418 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-44078b8d-3adc-49a1-8728-99e3604f6836 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:35.227143 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-44078b8d-3adc-49a1-8728-99e3604f6836 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] HTTP exception thrown: Instance ce13b8dc-7708-416a-b29b-d5cac40ad1a3 could not be found. Apr 05 11:19:35.227757 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-44078b8d-3adc-49a1-8728-99e3604f6836 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] Returning 404 to user: Instance ce13b8dc-7708-416a-b29b-d5cac40ad1a3 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:19:35.228571 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-44078b8d-3adc-49a1-8728-99e3604f6836 tempest-VolumesSnapshotTestJSON-1465526162 tempest-VolumesSnapshotTestJSON-1465526162-project] 10.222.0.39 "GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3" status: 404 len: 111 microversion: 2.1 time: 0.029058 Apr 05 11:19:35.229106 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 434/848] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:19:35 2022] GET /compute/v2.1/servers/ce13b8dc-7708-416a-b29b-d5cac40ad1a3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:19:54.427222 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d5d3fdd0-d491-476c-96d7-744bd7edab24 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:54.427756 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d5d3fdd0-d491-476c-96d7-744bd7edab24 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:54.433754 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5d3fdd0-d491-476c-96d7-744bd7edab24 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:54.434198 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5d3fdd0-d491-476c-96d7-744bd7edab24 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:54.434997 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5d3fdd0-d491-476c-96d7-744bd7edab24 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:54.435435 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5d3fdd0-d491-476c-96d7-744bd7edab24 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:54.514173 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-d5d3fdd0-d491-476c-96d7-744bd7edab24 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lazy-loading 'services' on Instance uuid a98ab2b1-5651-42f4-b1f3-de4469d542ad {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:19:54.793023 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d5d3fdd0-d491-476c-96d7-744bd7edab24 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/os-volume_attachments/3362e5d3-aae5-4a64-bbb5-7cae2eee7c31" status: 202 len: 0 microversion: 2.1 time: 0.534158 Apr 05 11:19:54.793545 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 415/849] 10.222.0.39 () {58 vars in 1415 bytes} [Tue Apr 5 11:19:54 2022] DELETE /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/os-volume_attachments/3362e5d3-aae5-4a64-bbb5-7cae2eee7c31 => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:19:56.957388 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-feba08f7-db54-440b-9a4b-5e3b3703d54a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:19:56.963454 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-feba08f7-db54-440b-9a4b-5e3b3703d54a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:56.963902 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-feba08f7-db54-440b-9a4b-5e3b3703d54a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:57.024261 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-feba08f7-db54-440b-9a4b-5e3b3703d54a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Going to try to stop instance {{(pid=117593) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 05 11:19:57.208072 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-feba08f7-db54-440b-9a4b-5e3b3703d54a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "POST /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/action" status: 202 len: 0 microversion: 2.1 time: 0.254389 Apr 05 11:19:57.213519 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 435/850] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:19:56 2022] POST /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:19:57.218737 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0772b348-e0a7-4f7e-9ba1-3fc6980973fa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:57.219541 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0772b348-e0a7-4f7e-9ba1-3fc6980973fa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:57.225904 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0772b348-e0a7-4f7e-9ba1-3fc6980973fa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:57.226350 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0772b348-e0a7-4f7e-9ba1-3fc6980973fa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:57.227143 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0772b348-e0a7-4f7e-9ba1-3fc6980973fa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:57.227634 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0772b348-e0a7-4f7e-9ba1-3fc6980973fa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:57.363260 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0772b348-e0a7-4f7e-9ba1-3fc6980973fa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:57.370953 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0772b348-e0a7-4f7e-9ba1-3fc6980973fa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.157623 Apr 05 11:19:57.371536 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 416/851] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:19:57 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:19:58.389242 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c8a4fe20-e95e-4f29-b024-480f84bfb971 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:58.389859 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c8a4fe20-e95e-4f29-b024-480f84bfb971 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:58.395926 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8a4fe20-e95e-4f29-b024-480f84bfb971 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:58.396372 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8a4fe20-e95e-4f29-b024-480f84bfb971 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:58.397156 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8a4fe20-e95e-4f29-b024-480f84bfb971 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:58.397590 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8a4fe20-e95e-4f29-b024-480f84bfb971 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:58.531804 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c8a4fe20-e95e-4f29-b024-480f84bfb971 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:58.539255 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c8a4fe20-e95e-4f29-b024-480f84bfb971 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.154744 Apr 05 11:19:58.539823 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 436/852] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:19:58 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:19:59.557584 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-62c48d4e-c61d-41bf-aff3-49230f026e4a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:19:59.558220 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-62c48d4e-c61d-41bf-aff3-49230f026e4a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:19:59.565269 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-62c48d4e-c61d-41bf-aff3-49230f026e4a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:59.565737 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-62c48d4e-c61d-41bf-aff3-49230f026e4a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:59.566497 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-62c48d4e-c61d-41bf-aff3-49230f026e4a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:19:59.566957 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-62c48d4e-c61d-41bf-aff3-49230f026e4a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:19:59.696804 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-62c48d4e-c61d-41bf-aff3-49230f026e4a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:19:59.703964 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-62c48d4e-c61d-41bf-aff3-49230f026e4a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.150510 Apr 05 11:19:59.704529 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 417/853] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:19:59 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:00.720891 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-331f528b-81da-40cb-a350-93a30afb5dad tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:00.721489 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-331f528b-81da-40cb-a350-93a30afb5dad tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:00.727991 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-331f528b-81da-40cb-a350-93a30afb5dad tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:00.728475 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-331f528b-81da-40cb-a350-93a30afb5dad tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:00.729226 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-331f528b-81da-40cb-a350-93a30afb5dad tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:00.729655 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-331f528b-81da-40cb-a350-93a30afb5dad tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:00.870745 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-331f528b-81da-40cb-a350-93a30afb5dad tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:00.878007 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-331f528b-81da-40cb-a350-93a30afb5dad tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.161036 Apr 05 11:20:00.878561 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 437/854] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:00 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:01.895454 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a83618db-9f91-4bdb-a0a8-8051980dc0a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:01.895990 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a83618db-9f91-4bdb-a0a8-8051980dc0a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:01.902999 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a83618db-9f91-4bdb-a0a8-8051980dc0a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:01.903474 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a83618db-9f91-4bdb-a0a8-8051980dc0a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:01.904243 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a83618db-9f91-4bdb-a0a8-8051980dc0a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:01.904683 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a83618db-9f91-4bdb-a0a8-8051980dc0a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:02.041576 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a83618db-9f91-4bdb-a0a8-8051980dc0a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:02.048943 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a83618db-9f91-4bdb-a0a8-8051980dc0a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.157470 Apr 05 11:20:02.049508 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 418/855] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:01 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:03.066083 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b3ae4d67-9c9a-4845-b725-10ef94957060 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:03.066719 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b3ae4d67-9c9a-4845-b725-10ef94957060 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:03.072898 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b3ae4d67-9c9a-4845-b725-10ef94957060 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:03.073343 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b3ae4d67-9c9a-4845-b725-10ef94957060 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:03.074097 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b3ae4d67-9c9a-4845-b725-10ef94957060 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:03.076245 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b3ae4d67-9c9a-4845-b725-10ef94957060 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:03.207392 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b3ae4d67-9c9a-4845-b725-10ef94957060 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:03.216403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b3ae4d67-9c9a-4845-b725-10ef94957060 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.154370 Apr 05 11:20:03.217035 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 438/856] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:03 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:04.234116 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c8ac4cbd-7b15-49ab-94d0-36c94336e86d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:04.234787 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c8ac4cbd-7b15-49ab-94d0-36c94336e86d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:04.241423 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c8ac4cbd-7b15-49ab-94d0-36c94336e86d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:04.241926 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c8ac4cbd-7b15-49ab-94d0-36c94336e86d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:04.242752 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c8ac4cbd-7b15-49ab-94d0-36c94336e86d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:04.243186 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c8ac4cbd-7b15-49ab-94d0-36c94336e86d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:04.375696 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c8ac4cbd-7b15-49ab-94d0-36c94336e86d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:04.382898 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c8ac4cbd-7b15-49ab-94d0-36c94336e86d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.153429 Apr 05 11:20:04.383466 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 419/857] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:04 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:20:05.400407 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-62f6c5aa-55e7-4b46-9cdf-171e0ba96468 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:05.400951 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-62f6c5aa-55e7-4b46-9cdf-171e0ba96468 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:05.407654 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62f6c5aa-55e7-4b46-9cdf-171e0ba96468 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:05.408099 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62f6c5aa-55e7-4b46-9cdf-171e0ba96468 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:05.408859 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62f6c5aa-55e7-4b46-9cdf-171e0ba96468 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:05.409287 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62f6c5aa-55e7-4b46-9cdf-171e0ba96468 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:05.546629 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-62f6c5aa-55e7-4b46-9cdf-171e0ba96468 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:05.553908 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-62f6c5aa-55e7-4b46-9cdf-171e0ba96468 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.157442 Apr 05 11:20:05.554515 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 439/858] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:05 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:05.972974 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:20:05.973227 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: Tue Apr 5 11:20:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:20:06.572421 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f0d84971-9a20-4ab2-983a-1463ac724227 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:06.572952 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f0d84971-9a20-4ab2-983a-1463ac724227 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:06.579805 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f0d84971-9a20-4ab2-983a-1463ac724227 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:06.580266 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f0d84971-9a20-4ab2-983a-1463ac724227 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:06.581028 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f0d84971-9a20-4ab2-983a-1463ac724227 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:06.581465 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f0d84971-9a20-4ab2-983a-1463ac724227 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:06.728857 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f0d84971-9a20-4ab2-983a-1463ac724227 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:06.728857 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f0d84971-9a20-4ab2-983a-1463ac724227 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.157413 Apr 05 11:20:06.728857 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 420/859] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:06 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:07.743339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-20400a0f-fa7a-45c0-9f3e-71c1a976d223 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:07.743950 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-20400a0f-fa7a-45c0-9f3e-71c1a976d223 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:07.753225 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-20400a0f-fa7a-45c0-9f3e-71c1a976d223 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:07.753681 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-20400a0f-fa7a-45c0-9f3e-71c1a976d223 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:07.754506 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-20400a0f-fa7a-45c0-9f3e-71c1a976d223 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:07.754972 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-20400a0f-fa7a-45c0-9f3e-71c1a976d223 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:07.883879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-20400a0f-fa7a-45c0-9f3e-71c1a976d223 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:07.891059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-20400a0f-fa7a-45c0-9f3e-71c1a976d223 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.151741 Apr 05 11:20:07.891603 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 440/860] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:07 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:08.907520 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-02693bbc-46cb-4ede-bcc9-105c22a4d17d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:08.908128 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-02693bbc-46cb-4ede-bcc9-105c22a4d17d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:08.914380 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-02693bbc-46cb-4ede-bcc9-105c22a4d17d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:08.914864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-02693bbc-46cb-4ede-bcc9-105c22a4d17d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:08.915624 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-02693bbc-46cb-4ede-bcc9-105c22a4d17d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:08.916054 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-02693bbc-46cb-4ede-bcc9-105c22a4d17d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:09.203156 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-02693bbc-46cb-4ede-bcc9-105c22a4d17d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:09.211257 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-02693bbc-46cb-4ede-bcc9-105c22a4d17d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.307638 Apr 05 11:20:09.211833 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 421/861] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:08 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:20:10.230933 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ffbbb27d-5cac-4cc7-a0ea-5ce328cf90a9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:10.231588 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ffbbb27d-5cac-4cc7-a0ea-5ce328cf90a9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:10.238155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ffbbb27d-5cac-4cc7-a0ea-5ce328cf90a9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:10.238592 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ffbbb27d-5cac-4cc7-a0ea-5ce328cf90a9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:10.239372 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ffbbb27d-5cac-4cc7-a0ea-5ce328cf90a9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:10.239800 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ffbbb27d-5cac-4cc7-a0ea-5ce328cf90a9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:10.374631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ffbbb27d-5cac-4cc7-a0ea-5ce328cf90a9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:10.381885 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ffbbb27d-5cac-4cc7-a0ea-5ce328cf90a9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.154988 Apr 05 11:20:10.382452 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 441/862] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:10 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:11.399000 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1a29ae8c-c5d1-48ea-87ce-9862357b214f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:11.399674 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1a29ae8c-c5d1-48ea-87ce-9862357b214f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:11.406219 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a29ae8c-c5d1-48ea-87ce-9862357b214f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:11.406691 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a29ae8c-c5d1-48ea-87ce-9862357b214f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:11.407495 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a29ae8c-c5d1-48ea-87ce-9862357b214f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:11.407932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a29ae8c-c5d1-48ea-87ce-9862357b214f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:11.663734 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1a29ae8c-c5d1-48ea-87ce-9862357b214f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:11.671377 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1a29ae8c-c5d1-48ea-87ce-9862357b214f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.276544 Apr 05 11:20:11.672138 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 422/863] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:11 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:12.689327 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-66880bd7-9324-400c-bd0f-8646cf52d39d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:12.690035 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-66880bd7-9324-400c-bd0f-8646cf52d39d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:12.706097 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66880bd7-9324-400c-bd0f-8646cf52d39d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:12.706097 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66880bd7-9324-400c-bd0f-8646cf52d39d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:12.706097 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66880bd7-9324-400c-bd0f-8646cf52d39d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:12.706097 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66880bd7-9324-400c-bd0f-8646cf52d39d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:12.865862 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-66880bd7-9324-400c-bd0f-8646cf52d39d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:12.874489 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-66880bd7-9324-400c-bd0f-8646cf52d39d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1676 microversion: 2.1 time: 0.189839 Apr 05 11:20:12.875754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 442/864] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:12 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:13.834749 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:20:13.835748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: Tue Apr 5 11:20:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:20:13.891666 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8e741fc6-09e9-44af-b8b5-2c76cc4f4b0a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:13.892271 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8e741fc6-09e9-44af-b8b5-2c76cc4f4b0a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:13.900173 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e741fc6-09e9-44af-b8b5-2c76cc4f4b0a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:13.900690 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e741fc6-09e9-44af-b8b5-2c76cc4f4b0a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:13.902111 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e741fc6-09e9-44af-b8b5-2c76cc4f4b0a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:13.902554 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e741fc6-09e9-44af-b8b5-2c76cc4f4b0a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:14.163908 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8e741fc6-09e9-44af-b8b5-2c76cc4f4b0a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:14.172086 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8e741fc6-09e9-44af-b8b5-2c76cc4f4b0a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1653 microversion: 2.1 time: 0.284125 Apr 05 11:20:14.172894 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 423/865] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:13 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1653 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:14.189772 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef20fccf-bc8b-45aa-9f22-8a265e520804 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:20:14.196374 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef20fccf-bc8b-45aa-9f22-8a265e520804 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:14.196829 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef20fccf-bc8b-45aa-9f22-8a265e520804 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:14.218917 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ef20fccf-bc8b-45aa-9f22-8a265e520804 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Going to try to start instance {{(pid=117593) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 05 11:20:14.443868 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ef20fccf-bc8b-45aa-9f22-8a265e520804 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "POST /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/action" status: 202 len: 0 microversion: 2.1 time: 0.258547 Apr 05 11:20:14.445968 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 443/866] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:20:14 2022] POST /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:20:14.453612 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-99c6ee86-50ec-4ec5-91af-a847be3d1958 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:14.455056 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-99c6ee86-50ec-4ec5-91af-a847be3d1958 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:14.465568 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-99c6ee86-50ec-4ec5-91af-a847be3d1958 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:14.466042 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-99c6ee86-50ec-4ec5-91af-a847be3d1958 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:14.470268 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-99c6ee86-50ec-4ec5-91af-a847be3d1958 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:14.471006 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-99c6ee86-50ec-4ec5-91af-a847be3d1958 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:14.642795 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-99c6ee86-50ec-4ec5-91af-a847be3d1958 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:14.653798 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-99c6ee86-50ec-4ec5-91af-a847be3d1958 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1662 microversion: 2.1 time: 0.204118 Apr 05 11:20:14.655119 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 424/867] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:14 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1662 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:15.680702 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-33cfda0e-5baa-42db-ba26-d32ab3c3e696 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:15.681655 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-33cfda0e-5baa-42db-ba26-d32ab3c3e696 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:15.690578 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33cfda0e-5baa-42db-ba26-d32ab3c3e696 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:15.691261 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33cfda0e-5baa-42db-ba26-d32ab3c3e696 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:15.692248 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33cfda0e-5baa-42db-ba26-d32ab3c3e696 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:15.692890 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33cfda0e-5baa-42db-ba26-d32ab3c3e696 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:15.851640 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-33cfda0e-5baa-42db-ba26-d32ab3c3e696 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:15.857984 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-33cfda0e-5baa-42db-ba26-d32ab3c3e696 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1662 microversion: 2.1 time: 0.189607 Apr 05 11:20:15.858547 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 444/868] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:15 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1662 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:16.875945 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9edaae56-d7be-4017-830f-120e5a975c47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:16.877754 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9edaae56-d7be-4017-830f-120e5a975c47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:16.886405 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9edaae56-d7be-4017-830f-120e5a975c47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:16.887385 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9edaae56-d7be-4017-830f-120e5a975c47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:16.888779 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9edaae56-d7be-4017-830f-120e5a975c47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:16.889451 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9edaae56-d7be-4017-830f-120e5a975c47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:17.048355 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9edaae56-d7be-4017-830f-120e5a975c47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:17.057251 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9edaae56-d7be-4017-830f-120e5a975c47 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1666 microversion: 2.1 time: 0.185659 Apr 05 11:20:17.068023 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 425/869] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:16 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1666 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:23.156123 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef64fbcb-2983-4740-8d20-34da3a1231cc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Action: 'create', calling method: .version_select at 0x7fec108204c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-72033448"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:20:23.170997 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-ef64fbcb-2983-4740-8d20-34da3a1231cc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Getting quotas for project 0c1827315aac4bfdacff856a13f90eb5. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:20:23.174922 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-ef64fbcb-2983-4740-8d20-34da3a1231cc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Getting quotas for user 068fa3223349449db508a275fa38ffdb and project 0c1827315aac4bfdacff856a13f90eb5. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:20:23.633067 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-ef64fbcb-2983-4740-8d20-34da3a1231cc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Getting quotas for project 0c1827315aac4bfdacff856a13f90eb5. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:20:23.637011 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-ef64fbcb-2983-4740-8d20-34da3a1231cc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Getting quotas for user 068fa3223349449db508a275fa38ffdb and project 0c1827315aac4bfdacff856a13f90eb5. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:20:23.656848 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ef64fbcb-2983-4740-8d20-34da3a1231cc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.708207 Apr 05 11:20:23.657442 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 445/870] 10.222.0.39 () {60 vars in 1157 bytes} [Tue Apr 5 11:20:22 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:48.591263 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f58c4174-a736-45fe-b864-122a6084e09c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:48.591263 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f58c4174-a736-45fe-b864-122a6084e09c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:48.592098 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f58c4174-a736-45fe-b864-122a6084e09c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:48.592432 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f58c4174-a736-45fe-b864-122a6084e09c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:48.593191 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f58c4174-a736-45fe-b864-122a6084e09c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:48.593621 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f58c4174-a736-45fe-b864-122a6084e09c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:48.615951 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f58c4174-a736-45fe-b864-122a6084e09c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27/ips" status: 200 len: 150 microversion: 2.1 time: 0.136740 Apr 05 11:20:48.616501 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 426/871] 10.222.0.39 () {58 vars in 1247 bytes} [Tue Apr 5 11:20:48 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27/ips => generated 150 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:20:48.629991 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-446dd501-2c81-411d-9dce-e97b8cac6fd1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51d932f8-9b6b-4cbf-b1b1-a61564bf2591"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:20:48.631142 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-446dd501-2c81-411d-9dce-e97b8cac6fd1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:48.637636 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-446dd501-2c81-411d-9dce-e97b8cac6fd1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:48.638084 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-446dd501-2c81-411d-9dce-e97b8cac6fd1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:48.638926 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-446dd501-2c81-411d-9dce-e97b8cac6fd1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:48.639365 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-446dd501-2c81-411d-9dce-e97b8cac6fd1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:48.714199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-446dd501-2c81-411d-9dce-e97b8cac6fd1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Invalid volume: volume 51d932f8-9b6b-4cbf-b1b1-a61564bf2591 is already attached to instances: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f Apr 05 11:20:48.714879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-446dd501-2c81-411d-9dce-e97b8cac6fd1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 400 to user: Invalid volume: volume 51d932f8-9b6b-4cbf-b1b1-a61564bf2591 is already attached to instances: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:20:48.715717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-446dd501-2c81-411d-9dce-e97b8cac6fd1 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "POST /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090388 Apr 05 11:20:48.716267 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 446/872] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:20:48 2022] POST /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:20:48.724711 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c49db27d-20e1-4e11-9fcf-da704f0769ae tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:48.725233 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c49db27d-20e1-4e11-9fcf-da704f0769ae tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:48.731689 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c49db27d-20e1-4e11-9fcf-da704f0769ae tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:48.732299 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c49db27d-20e1-4e11-9fcf-da704f0769ae tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:48.733041 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c49db27d-20e1-4e11-9fcf-da704f0769ae tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:48.733488 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c49db27d-20e1-4e11-9fcf-da704f0769ae tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:48.757945 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c49db27d-20e1-4e11-9fcf-da704f0769ae tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:20:49.147236 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c49db27d-20e1-4e11-9fcf-da704f0769ae tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 204 len: 0 microversion: 2.1 time: 0.426072 Apr 05 11:20:49.147839 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 427/873] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:20:48 2022] DELETE /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:20:49.156635 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7f228174-9b3d-4d6d-b539-84511a22b7d8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:49.157261 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7f228174-9b3d-4d6d-b539-84511a22b7d8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:49.166416 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f228174-9b3d-4d6d-b539-84511a22b7d8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:49.166895 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f228174-9b3d-4d6d-b539-84511a22b7d8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:49.167749 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f228174-9b3d-4d6d-b539-84511a22b7d8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:49.168192 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f228174-9b3d-4d6d-b539-84511a22b7d8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:49.299239 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7f228174-9b3d-4d6d-b539-84511a22b7d8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:49.306505 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7f228174-9b3d-4d6d-b539-84511a22b7d8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1681 microversion: 2.1 time: 0.153857 Apr 05 11:20:49.307086 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 447/874] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:49 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:50.324496 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-be005d02-8fd9-429f-a587-cd9ea25da56e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:50.325197 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-be005d02-8fd9-429f-a587-cd9ea25da56e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:50.331561 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be005d02-8fd9-429f-a587-cd9ea25da56e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:50.332014 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be005d02-8fd9-429f-a587-cd9ea25da56e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:50.332779 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be005d02-8fd9-429f-a587-cd9ea25da56e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:50.333216 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be005d02-8fd9-429f-a587-cd9ea25da56e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:50.466769 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-be005d02-8fd9-429f-a587-cd9ea25da56e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:50.474016 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-be005d02-8fd9-429f-a587-cd9ea25da56e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1681 microversion: 2.1 time: 0.153797 Apr 05 11:20:50.477326 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 428/875] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:50 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:51.493904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-328842c0-46de-4b0f-a6ce-581c6448ff94 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:51.494509 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-328842c0-46de-4b0f-a6ce-581c6448ff94 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:51.500941 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-328842c0-46de-4b0f-a6ce-581c6448ff94 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:51.507487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-328842c0-46de-4b0f-a6ce-581c6448ff94 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:51.507487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-328842c0-46de-4b0f-a6ce-581c6448ff94 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:51.507487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-328842c0-46de-4b0f-a6ce-581c6448ff94 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:51.635624 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-328842c0-46de-4b0f-a6ce-581c6448ff94 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:51.643040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-328842c0-46de-4b0f-a6ce-581c6448ff94 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1681 microversion: 2.1 time: 0.153626 Apr 05 11:20:51.643637 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 448/876] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:51 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:52.659786 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4fbbc7e6-4489-454f-aa82-bb3850ee60d6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:52.660511 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4fbbc7e6-4489-454f-aa82-bb3850ee60d6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:52.667900 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4fbbc7e6-4489-454f-aa82-bb3850ee60d6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:52.668441 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4fbbc7e6-4489-454f-aa82-bb3850ee60d6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:52.669296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4fbbc7e6-4489-454f-aa82-bb3850ee60d6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:52.669807 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4fbbc7e6-4489-454f-aa82-bb3850ee60d6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:52.733893 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4fbbc7e6-4489-454f-aa82-bb3850ee60d6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:52.741911 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4fbbc7e6-4489-454f-aa82-bb3850ee60d6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1614 microversion: 2.1 time: 0.086029 Apr 05 11:20:52.742784 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 429/877] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:52 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:52.887550 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-dd64add7-acb8-40de-82c0-aceac98adce1 req-4f064ed3-20ea-4763-95b8-21415ad41cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83911c9a-66fa-4dc2-b353-e8367ed89f27", "name": "network-vif-deleted", "tag": "41e4db55-0008-44c7-9892-ce0d8234ca56"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:20:52.897181 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-dd64add7-acb8-40de-82c0-aceac98adce1 req-4f064ed3-20ea-4763-95b8-21415ad41cc5 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:52.903245 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-dd64add7-acb8-40de-82c0-aceac98adce1 req-4f064ed3-20ea-4763-95b8-21415ad41cc5 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:52.909395 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-dd64add7-acb8-40de-82c0-aceac98adce1 req-4f064ed3-20ea-4763-95b8-21415ad41cc5 service nova] Creating event network-vif-deleted:41e4db55-0008-44c7-9892-ce0d8234ca56 for instance 83911c9a-66fa-4dc2-b353-e8367ed89f27 on hv-cinder-81899 Apr 05 11:20:52.915164 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-dd64add7-acb8-40de-82c0-aceac98adce1 req-4f064ed3-20ea-4763-95b8-21415ad41cc5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031787 Apr 05 11:20:52.918744 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 449/878] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:20:53.262779 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fdc000ca-d6d7-4fa1-8c01-4599cd2d3ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:53.263579 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fdc000ca-d6d7-4fa1-8c01-4599cd2d3ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:53.269394 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fdc000ca-d6d7-4fa1-8c01-4599cd2d3ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:53.269844 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fdc000ca-d6d7-4fa1-8c01-4599cd2d3ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:53.270619 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fdc000ca-d6d7-4fa1-8c01-4599cd2d3ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:53.271163 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fdc000ca-d6d7-4fa1-8c01-4599cd2d3ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:53.305535 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fdc000ca-d6d7-4fa1-8c01-4599cd2d3ac0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-volume_attachments/6ae74597-915a-49ab-8e3c-ba081005a86d" status: 200 len: 194 microversion: 2.20 time: 0.047377 Apr 05 11:20:53.321000 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 430/879] 10.222.0.39 () {60 vars in 1453 bytes} [Tue Apr 5 11:20:53 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-volume_attachments/6ae74597-915a-49ab-8e3c-ba081005a86d => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:20:53.376225 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-82fd2a7d-3e39-429b-80a1-af7a9d41af33 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:53.376916 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-82fd2a7d-3e39-429b-80a1-af7a9d41af33 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:53.383627 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-82fd2a7d-3e39-429b-80a1-af7a9d41af33 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:53.392872 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-82fd2a7d-3e39-429b-80a1-af7a9d41af33 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:53.392872 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-82fd2a7d-3e39-429b-80a1-af7a9d41af33 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:53.392872 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-82fd2a7d-3e39-429b-80a1-af7a9d41af33 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:53.465144 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-82fd2a7d-3e39-429b-80a1-af7a9d41af33 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lazy-loading 'services' on Instance uuid c900362d-904b-4d64-a9a3-ab381ca756e3 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:20:53.746720 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-82fd2a7d-3e39-429b-80a1-af7a9d41af33 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-volume_attachments/6ae74597-915a-49ab-8e3c-ba081005a86d" status: 202 len: 0 microversion: 2.20 time: 0.374663 Apr 05 11:20:53.750968 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 450/880] 10.222.0.39 () {60 vars in 1456 bytes} [Tue Apr 5 11:20:53 2022] DELETE /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-volume_attachments/6ae74597-915a-49ab-8e3c-ba081005a86d => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:20:53.757492 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a66495b4-46a6-4a00-9bd4-a31adbadf4eb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:53.758864 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4c85e214-338b-4805-b2ed-d6c168bb7578 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:53.759915 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a66495b4-46a6-4a00-9bd4-a31adbadf4eb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:53.760138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4c85e214-338b-4805-b2ed-d6c168bb7578 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:53.766776 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a66495b4-46a6-4a00-9bd4-a31adbadf4eb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:53.767314 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a66495b4-46a6-4a00-9bd4-a31adbadf4eb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:53.767495 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c85e214-338b-4805-b2ed-d6c168bb7578 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:53.767721 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c85e214-338b-4805-b2ed-d6c168bb7578 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:53.768004 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a66495b4-46a6-4a00-9bd4-a31adbadf4eb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:53.768437 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a66495b4-46a6-4a00-9bd4-a31adbadf4eb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:53.768714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c85e214-338b-4805-b2ed-d6c168bb7578 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:53.769170 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c85e214-338b-4805-b2ed-d6c168bb7578 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:53.800945 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c85e214-338b-4805-b2ed-d6c168bb7578 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:53.801414 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c85e214-338b-4805-b2ed-d6c168bb7578 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:53.801859 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-4c85e214-338b-4805-b2ed-d6c168bb7578 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lazy-loading 'fault' on Instance uuid 83911c9a-66fa-4dc2-b353-e8367ed89f27 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:20:53.803222 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a66495b4-46a6-4a00-9bd4-a31adbadf4eb tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050429 Apr 05 11:20:53.803806 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 431/881] 10.222.0.39 () {60 vars in 1342 bytes} [Tue Apr 5 11:20:53 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:20:53.849429 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4c85e214-338b-4805-b2ed-d6c168bb7578 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:53.858562 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4c85e214-338b-4805-b2ed-d6c168bb7578 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 200 len: 1331 microversion: 2.1 time: 0.104234 Apr 05 11:20:53.859265 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 451/882] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:53 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:20:54.761525 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1785151929", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-72033448", "security_groups": [{"name": "tempest-secgroup-smoke-300189603"}], "block_device_mapping_v2": [{"uuid": "20082c8b-08e7-41f6-8081-03a9831f1d3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "15ec88ec-a078-4d94-a658-456bc06f4f38"}]}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:20:54.815696 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4a2ab779-2838-47a7-9f05-9ffede1d29b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:54.816711 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4a2ab779-2838-47a7-9f05-9ffede1d29b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:54.824216 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a2ab779-2838-47a7-9f05-9ffede1d29b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:54.829717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a2ab779-2838-47a7-9f05-9ffede1d29b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:54.830798 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a2ab779-2838-47a7-9f05-9ffede1d29b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:54.831442 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a2ab779-2838-47a7-9f05-9ffede1d29b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:54.864648 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4a2ab779-2838-47a7-9f05-9ffede1d29b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052615 Apr 05 11:20:54.870101 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 452/883] 10.222.0.39 () {60 vars in 1342 bytes} [Tue Apr 5 11:20:54 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:20:54.877083 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3106273f-c17a-4792-b528-a1339f25baa5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:54.877998 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3106273f-c17a-4792-b528-a1339f25baa5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:54.888756 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3106273f-c17a-4792-b528-a1339f25baa5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:54.889993 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3106273f-c17a-4792-b528-a1339f25baa5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:54.891154 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3106273f-c17a-4792-b528-a1339f25baa5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:54.891782 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3106273f-c17a-4792-b528-a1339f25baa5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:54.906727 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-3106273f-c17a-4792-b528-a1339f25baa5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Instance 83911c9a-66fa-4dc2-b353-e8367ed89f27 could not be found. Apr 05 11:20:54.907586 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3106273f-c17a-4792-b528-a1339f25baa5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 404 to user: Instance 83911c9a-66fa-4dc2-b353-e8367ed89f27 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:20:54.908589 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3106273f-c17a-4792-b528-a1339f25baa5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 404 len: 111 microversion: 2.1 time: 0.035278 Apr 05 11:20:54.909321 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 453/884] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:54 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:20:54.917959 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8d5ea680-6b38-47c7-875a-cd1d02aa8285 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '.version_select at 0x7fec108935e0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:54.942007 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] validate_networks() for [('15ec88ec-a078-4d94-a658-456bc06f4f38', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:20:55.040855 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8d5ea680-6b38-47c7-875a-cd1d02aa8285 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682094841" status: 202 len: 0 microversion: 2.1 time: 0.126918 Apr 05 11:20:55.042091 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 454/885] 10.222.0.39 () {58 vars in 1220 bytes} [Tue Apr 5 11:20:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682094841 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:20:55.652022 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:20:55.652490 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:20:55.653027 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:20:55.653494 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:20:55.654138 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:20:55.663434 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:55.664101 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:55.664926 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:55.665370 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:55.685085 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Getting quotas for project 0c1827315aac4bfdacff856a13f90eb5. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:20:55.689003 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Getting quotas for user 068fa3223349449db508a275fa38ffdb and project 0c1827315aac4bfdacff856a13f90eb5. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:20:55.749641 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:20:55.751878 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20082c8b-08e7-41f6-8081-03a9831f1d3d',volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:20:55.878265 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dac81c0a-ca5c-4601-bcc1-c3a9f21540c4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:55.879210 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dac81c0a-ca5c-4601-bcc1-c3a9f21540c4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:55.886394 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dac81c0a-ca5c-4601-bcc1-c3a9f21540c4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:55.886862 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dac81c0a-ca5c-4601-bcc1-c3a9f21540c4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:55.887637 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dac81c0a-ca5c-4601-bcc1-c3a9f21540c4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:55.888076 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dac81c0a-ca5c-4601-bcc1-c3a9f21540c4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:55.914780 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dac81c0a-ca5c-4601-bcc1-c3a9f21540c4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041937 Apr 05 11:20:55.915270 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 455/886] 10.222.0.39 () {60 vars in 1342 bytes} [Tue Apr 5 11:20:55 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:20:55.972693 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-cd25b917-f01f-4ac5-b73e-a91166c82bdc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:55.973183 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-cd25b917-f01f-4ac5-b73e-a91166c82bdc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:55.979072 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd25b917-f01f-4ac5-b73e-a91166c82bdc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:55.979523 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd25b917-f01f-4ac5-b73e-a91166c82bdc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:55.980284 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd25b917-f01f-4ac5-b73e-a91166c82bdc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:55.981002 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd25b917-f01f-4ac5-b73e-a91166c82bdc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:56.005925 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-cd25b917-f01f-4ac5-b73e-a91166c82bdc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:20:56.311878 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e583a74d-9385-4607-98f6-fcf888f35174 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.556555 Apr 05 11:20:56.312690 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 432/887] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:20:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:20:56.317347 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c5d3a884-b19d-422a-9a9c-c585b5cbccde tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:56.317627 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c5d3a884-b19d-422a-9a9c-c585b5cbccde tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:56.323699 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5d3a884-b19d-422a-9a9c-c585b5cbccde tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:56.324151 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5d3a884-b19d-422a-9a9c-c585b5cbccde tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:56.324926 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5d3a884-b19d-422a-9a9c-c585b5cbccde tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:56.325365 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c5d3a884-b19d-422a-9a9c-c585b5cbccde tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:56.383918 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-cd25b917-f01f-4ac5-b73e-a91166c82bdc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 204 len: 0 microversion: 2.20 time: 0.414299 Apr 05 11:20:56.384966 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 456/888] 10.222.0.39 () {60 vars in 1279 bytes} [Tue Apr 5 11:20:55 2022] DELETE /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 05 11:20:56.392142 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f27d1af7-ea78-4081-b950-663aa800a8e1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:56.393089 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f27d1af7-ea78-4081-b950-663aa800a8e1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:56.403973 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-c5d3a884-b19d-422a-9a9c-c585b5cbccde tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lazy-loading 'services' on Instance uuid 8e206c1c-372e-45c5-bb53-11d7ba0fb01f {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:20:56.448745 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f27d1af7-ea78-4081-b950-663aa800a8e1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:56.456765 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f27d1af7-ea78-4081-b950-663aa800a8e1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1093 microversion: 2.1 time: 0.069525 Apr 05 11:20:56.457432 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 457/889] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:56 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:56.462873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3b306201-0d75-4d73-b748-6f38e28b53be tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:56.463557 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3b306201-0d75-4d73-b748-6f38e28b53be tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:56.470112 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b306201-0d75-4d73-b748-6f38e28b53be tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:56.470565 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b306201-0d75-4d73-b748-6f38e28b53be tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:56.471380 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b306201-0d75-4d73-b748-6f38e28b53be tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:56.471958 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b306201-0d75-4d73-b748-6f38e28b53be tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:56.612931 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3b306201-0d75-4d73-b748-6f38e28b53be tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:56.621553 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3b306201-0d75-4d73-b748-6f38e28b53be tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:56.623238 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3b306201-0d75-4d73-b748-6f38e28b53be tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:56.624392 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3b306201-0d75-4d73-b748-6f38e28b53be tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.165979 Apr 05 11:20:56.625022 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 458/890] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:20:56 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:20:56.706970 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c5d3a884-b19d-422a-9a9c-c585b5cbccde tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-volume_attachments/51d932f8-9b6b-4cbf-b1b1-a61564bf2591" status: 202 len: 0 microversion: 2.1 time: 0.393055 Apr 05 11:20:56.707579 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 433/891] 10.222.0.39 () {58 vars in 1415 bytes} [Tue Apr 5 11:20:56 2022] DELETE /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-volume_attachments/51d932f8-9b6b-4cbf-b1b1-a61564bf2591 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:20:56.715740 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5f6fbb8f-b02d-4e2b-914b-238f0de139f4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:56.716750 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5f6fbb8f-b02d-4e2b-914b-238f0de139f4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:56.722831 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5f6fbb8f-b02d-4e2b-914b-238f0de139f4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:56.723291 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5f6fbb8f-b02d-4e2b-914b-238f0de139f4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:56.724060 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5f6fbb8f-b02d-4e2b-914b-238f0de139f4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:56.724501 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5f6fbb8f-b02d-4e2b-914b-238f0de139f4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:56.754049 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5f6fbb8f-b02d-4e2b-914b-238f0de139f4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042239 Apr 05 11:20:56.754668 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 459/892] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:20:56 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:20:57.276689 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cda20d6b-3909-4864-9cd6-51df08d384c0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b3c2cbb-29d0-4c7e-aab7-13095307ff04"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:20:57.310796 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cda20d6b-3909-4864-9cd6-51df08d384c0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:57.310796 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cda20d6b-3909-4864-9cd6-51df08d384c0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:57.310796 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cda20d6b-3909-4864-9cd6-51df08d384c0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:57.310796 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cda20d6b-3909-4864-9cd6-51df08d384c0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:57.311826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cda20d6b-3909-4864-9cd6-51df08d384c0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:57.474360 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef69dd0e-313b-4384-9175-675dcfddbf64 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:57.475108 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ef69dd0e-313b-4384-9175-675dcfddbf64 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:57.525910 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef69dd0e-313b-4384-9175-675dcfddbf64 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:57.532414 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ef69dd0e-313b-4384-9175-675dcfddbf64 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1093 microversion: 2.1 time: 0.062004 Apr 05 11:20:57.532973 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 460/893] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:57 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1093 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:20:57.643446 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8eb03e14-8e99-4951-a4e6-eb84098dcf99 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:57.644108 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8eb03e14-8e99-4951-a4e6-eb84098dcf99 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:57.650296 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8eb03e14-8e99-4951-a4e6-eb84098dcf99 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:57.650775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8eb03e14-8e99-4951-a4e6-eb84098dcf99 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:57.651659 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8eb03e14-8e99-4951-a4e6-eb84098dcf99 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:57.652084 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8eb03e14-8e99-4951-a4e6-eb84098dcf99 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:57.801855 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8eb03e14-8e99-4951-a4e6-eb84098dcf99 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:57.801855 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8eb03e14-8e99-4951-a4e6-eb84098dcf99 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:57.802119 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8eb03e14-8e99-4951-a4e6-eb84098dcf99 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:57.802119 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8eb03e14-8e99-4951-a4e6-eb84098dcf99 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.158177 Apr 05 11:20:57.802119 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 461/894] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:20:57 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:20:57.803358 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-03263729-712a-438f-bf27-9d7a2da088dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:57.804377 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-03263729-712a-438f-bf27-9d7a2da088dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:57.811324 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03263729-712a-438f-bf27-9d7a2da088dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:57.811809 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03263729-712a-438f-bf27-9d7a2da088dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:57.812628 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03263729-712a-438f-bf27-9d7a2da088dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:57.813063 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03263729-712a-438f-bf27-9d7a2da088dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:57.841172 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-03263729-712a-438f-bf27-9d7a2da088dd tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041925 Apr 05 11:20:57.841732 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 462/895] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:20:57 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:20:58.549309 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8622e147-ee18-42da-9ace-550ff14e3d95 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:58.549946 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8622e147-ee18-42da-9ace-550ff14e3d95 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:58.556667 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8622e147-ee18-42da-9ace-550ff14e3d95 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:58.562279 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8622e147-ee18-42da-9ace-550ff14e3d95 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:58.562279 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8622e147-ee18-42da-9ace-550ff14e3d95 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:58.562279 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8622e147-ee18-42da-9ace-550ff14e3d95 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:58.617400 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8622e147-ee18-42da-9ace-550ff14e3d95 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:58.624998 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8622e147-ee18-42da-9ace-550ff14e3d95 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1143 microversion: 2.1 time: 0.079649 Apr 05 11:20:58.625569 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 463/896] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:58 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:20:58.817811 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-df968590-178d-4515-bbf1-266ad251e088 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:58.818476 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-df968590-178d-4515-bbf1-266ad251e088 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:58.825459 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df968590-178d-4515-bbf1-266ad251e088 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:58.825901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df968590-178d-4515-bbf1-266ad251e088 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:58.826822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df968590-178d-4515-bbf1-266ad251e088 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:58.827258 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df968590-178d-4515-bbf1-266ad251e088 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:58.856258 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cda20d6b-3909-4864-9cd6-51df08d384c0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "POST /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.681658 Apr 05 11:20:58.857217 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 434/897] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:20:57 2022] POST /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-volume_attachments => generated 194 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:20:58.875158 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1a9e16e6-0b0d-49d6-a741-da7d6c112182 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:58.876691 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1a9e16e6-0b0d-49d6-a741-da7d6c112182 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:58.884810 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a9e16e6-0b0d-49d6-a741-da7d6c112182 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:58.889978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a9e16e6-0b0d-49d6-a741-da7d6c112182 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:58.889978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a9e16e6-0b0d-49d6-a741-da7d6c112182 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:58.889978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a9e16e6-0b0d-49d6-a741-da7d6c112182 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:58.920192 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1a9e16e6-0b0d-49d6-a741-da7d6c112182 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061553 Apr 05 11:20:58.920975 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 435/898] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:20:58 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:20:59.047308 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-df968590-178d-4515-bbf1-266ad251e088 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:59.056739 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-df968590-178d-4515-bbf1-266ad251e088 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:59.062808 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-df968590-178d-4515-bbf1-266ad251e088 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:59.064203 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-df968590-178d-4515-bbf1-266ad251e088 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1726 microversion: 2.20 time: 0.250468 Apr 05 11:20:59.064777 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 464/899] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:20:58 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1726 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:20:59.642748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1e0cb5d0-62cc-4dfa-8629-07645cbce025 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:59.643364 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1e0cb5d0-62cc-4dfa-8629-07645cbce025 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:59.650253 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e0cb5d0-62cc-4dfa-8629-07645cbce025 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:59.650743 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e0cb5d0-62cc-4dfa-8629-07645cbce025 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:59.651523 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e0cb5d0-62cc-4dfa-8629-07645cbce025 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:59.651963 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e0cb5d0-62cc-4dfa-8629-07645cbce025 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:59.717102 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1e0cb5d0-62cc-4dfa-8629-07645cbce025 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:20:59.724790 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1e0cb5d0-62cc-4dfa-8629-07645cbce025 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1191 microversion: 2.1 time: 0.086067 Apr 05 11:20:59.725359 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 436/900] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:20:59 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:20:59.937366 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a0aa655f-7ebc-4c74-845b-1c99a45d3e5b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:20:59.941396 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a0aa655f-7ebc-4c74-845b-1c99a45d3e5b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:20:59.969379 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-9e90093a-53b0-4f5a-9a19-82c591e004a8 req-1704624b-b548-4ad3-91d3-634247e24f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c900362d-904b-4d64-a9a3-ab381ca756e3", "name": "network-vif-deleted", "tag": "be14224c-0258-4dc2-9ce4-f41347c20fc0"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:20:59.969379 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-9e90093a-53b0-4f5a-9a19-82c591e004a8 req-1704624b-b548-4ad3-91d3-634247e24f7b service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:59.969379 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-9e90093a-53b0-4f5a-9a19-82c591e004a8 req-1704624b-b548-4ad3-91d3-634247e24f7b service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:59.969997 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0aa655f-7ebc-4c74-845b-1c99a45d3e5b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:59.969997 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0aa655f-7ebc-4c74-845b-1c99a45d3e5b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:59.970742 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0aa655f-7ebc-4c74-845b-1c99a45d3e5b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:20:59.971190 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0aa655f-7ebc-4c74-845b-1c99a45d3e5b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:20:59.988001 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-9e90093a-53b0-4f5a-9a19-82c591e004a8 req-1704624b-b548-4ad3-91d3-634247e24f7b service nova] Creating event network-vif-deleted:be14224c-0258-4dc2-9ce4-f41347c20fc0 for instance c900362d-904b-4d64-a9a3-ab381ca756e3 on hv-cinder-81899 Apr 05 11:20:59.995355 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-9e90093a-53b0-4f5a-9a19-82c591e004a8 req-1704624b-b548-4ad3-91d3-634247e24f7b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045327 Apr 05 11:21:00.001415 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 437/901] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:21:00.031478 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a0aa655f-7ebc-4c74-845b-1c99a45d3e5b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103324 Apr 05 11:21:00.037235 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 465/902] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:20:59 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:21:00.086510 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8631aa66-a51f-445a-b50f-9c371885d0c9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:00.087810 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8631aa66-a51f-445a-b50f-9c371885d0c9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:00.112139 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8631aa66-a51f-445a-b50f-9c371885d0c9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:00.112977 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8631aa66-a51f-445a-b50f-9c371885d0c9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:00.115687 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8631aa66-a51f-445a-b50f-9c371885d0c9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:00.117693 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8631aa66-a51f-445a-b50f-9c371885d0c9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:00.139819 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d1af85f5-07ed-4d50-91a9-f94081226f7d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:00.140605 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d1af85f5-07ed-4d50-91a9-f94081226f7d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:00.154701 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d1af85f5-07ed-4d50-91a9-f94081226f7d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:00.156267 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d1af85f5-07ed-4d50-91a9-f94081226f7d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:00.158271 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d1af85f5-07ed-4d50-91a9-f94081226f7d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:00.160338 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d1af85f5-07ed-4d50-91a9-f94081226f7d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:00.215281 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d1af85f5-07ed-4d50-91a9-f94081226f7d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:21:00.225693 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8631aa66-a51f-445a-b50f-9c371885d0c9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:00.235448 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8631aa66-a51f-445a-b50f-9c371885d0c9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:00.238255 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8631aa66-a51f-445a-b50f-9c371885d0c9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:00.239814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8631aa66-a51f-445a-b50f-9c371885d0c9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1367 microversion: 2.20 time: 0.159980 Apr 05 11:21:00.241264 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 438/903] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:00 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:00.743952 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-32a915b2-90dd-4bf9-b907-7994e4e8adc1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:00.744997 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-32a915b2-90dd-4bf9-b907-7994e4e8adc1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:00.751899 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-32a915b2-90dd-4bf9-b907-7994e4e8adc1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:00.752358 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-32a915b2-90dd-4bf9-b907-7994e4e8adc1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:00.753145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-32a915b2-90dd-4bf9-b907-7994e4e8adc1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:00.753585 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-32a915b2-90dd-4bf9-b907-7994e4e8adc1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:00.778964 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d1af85f5-07ed-4d50-91a9-f94081226f7d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 204 len: 0 microversion: 2.1 time: 0.642758 Apr 05 11:21:00.788160 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 466/904] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:21:00 2022] DELETE /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:21:00.796872 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fa0a1d24-e177-4756-a6f3-8545a0cdf6ad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:00.798406 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fa0a1d24-e177-4756-a6f3-8545a0cdf6ad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:00.806051 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fa0a1d24-e177-4756-a6f3-8545a0cdf6ad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:00.806699 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fa0a1d24-e177-4756-a6f3-8545a0cdf6ad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:00.807989 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fa0a1d24-e177-4756-a6f3-8545a0cdf6ad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:00.808733 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fa0a1d24-e177-4756-a6f3-8545a0cdf6ad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:00.833772 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-32a915b2-90dd-4bf9-b907-7994e4e8adc1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:00.850853 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-32a915b2-90dd-4bf9-b907-7994e4e8adc1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1209 microversion: 2.1 time: 0.111816 Apr 05 11:21:00.853031 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 439/905] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:00 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1209 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:01.144678 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fa0a1d24-e177-4756-a6f3-8545a0cdf6ad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:01.152286 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fa0a1d24-e177-4756-a6f3-8545a0cdf6ad tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1681 microversion: 2.1 time: 0.362465 Apr 05 11:21:01.153135 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 467/906] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:00 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1681 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:01.259181 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bb8756ec-3e25-431c-82d3-f8fb9c04ff45 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:01.260430 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bb8756ec-3e25-431c-82d3-f8fb9c04ff45 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:01.269501 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bb8756ec-3e25-431c-82d3-f8fb9c04ff45 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:01.269501 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bb8756ec-3e25-431c-82d3-f8fb9c04ff45 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:01.269501 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bb8756ec-3e25-431c-82d3-f8fb9c04ff45 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:01.269501 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bb8756ec-3e25-431c-82d3-f8fb9c04ff45 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:01.306307 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bb8756ec-3e25-431c-82d3-f8fb9c04ff45 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:01.306792 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bb8756ec-3e25-431c-82d3-f8fb9c04ff45 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:01.307250 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-bb8756ec-3e25-431c-82d3-f8fb9c04ff45 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lazy-loading 'fault' on Instance uuid c900362d-904b-4d64-a9a3-ab381ca756e3 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:21:01.349711 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bb8756ec-3e25-431c-82d3-f8fb9c04ff45 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:01.357904 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bb8756ec-3e25-431c-82d3-f8fb9c04ff45 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:01.359444 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bb8756ec-3e25-431c-82d3-f8fb9c04ff45 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:01.360588 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bb8756ec-3e25-431c-82d3-f8fb9c04ff45 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 200 len: 1372 microversion: 2.20 time: 0.106349 Apr 05 11:21:01.361258 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 440/907] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:01 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:01.877215 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bde44230-8ae5-4526-a83d-620f16e91f6a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:01.880754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bde44230-8ae5-4526-a83d-620f16e91f6a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:01.884460 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bde44230-8ae5-4526-a83d-620f16e91f6a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:01.884915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bde44230-8ae5-4526-a83d-620f16e91f6a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:01.885699 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bde44230-8ae5-4526-a83d-620f16e91f6a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:01.886131 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bde44230-8ae5-4526-a83d-620f16e91f6a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:02.091331 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bde44230-8ae5-4526-a83d-620f16e91f6a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:02.099052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bde44230-8ae5-4526-a83d-620f16e91f6a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1276 microversion: 2.1 time: 0.225589 Apr 05 11:21:02.113711 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 468/908] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:01 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1276 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:02.170645 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7da22161-5055-40e6-a005-8a7c3e6fb13f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:02.171262 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7da22161-5055-40e6-a005-8a7c3e6fb13f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:02.180522 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7da22161-5055-40e6-a005-8a7c3e6fb13f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:02.184453 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7da22161-5055-40e6-a005-8a7c3e6fb13f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:02.184453 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7da22161-5055-40e6-a005-8a7c3e6fb13f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:02.184453 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7da22161-5055-40e6-a005-8a7c3e6fb13f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:02.202112 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-68268a40-343d-4f28-b219-f15d497d6542 req-234e43fb-d54c-401d-877b-3df1e52fd34b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af2a30d-f115-44a9-9a90-d1699560bd75", "tag": "636d7202-7eb2-4976-9af9-7eb3c2e5f3e2"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:02.217454 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-68268a40-343d-4f28-b219-f15d497d6542 req-234e43fb-d54c-401d-877b-3df1e52fd34b service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:02.218682 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-68268a40-343d-4f28-b219-f15d497d6542 req-234e43fb-d54c-401d-877b-3df1e52fd34b service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:02.235371 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-68268a40-343d-4f28-b219-f15d497d6542 req-234e43fb-d54c-401d-877b-3df1e52fd34b service nova] Creating event network-changed:636d7202-7eb2-4976-9af9-7eb3c2e5f3e2 for instance 1af2a30d-f115-44a9-9a90-d1699560bd75 on hv-cinder-81899 Apr 05 11:21:02.240994 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-68268a40-343d-4f28-b219-f15d497d6542 req-234e43fb-d54c-401d-877b-3df1e52fd34b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044048 Apr 05 11:21:02.241970 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 469/909] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:21:02.383067 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-57117950-03d4-408f-9c43-b661126958a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:02.384221 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-57117950-03d4-408f-9c43-b661126958a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:02.391571 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57117950-03d4-408f-9c43-b661126958a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:02.392256 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57117950-03d4-408f-9c43-b661126958a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:02.393637 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57117950-03d4-408f-9c43-b661126958a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:02.394279 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57117950-03d4-408f-9c43-b661126958a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:02.407903 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-57117950-03d4-408f-9c43-b661126958a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] HTTP exception thrown: Instance c900362d-904b-4d64-a9a3-ab381ca756e3 could not be found. Apr 05 11:21:02.408742 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-57117950-03d4-408f-9c43-b661126958a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Returning 404 to user: Instance c900362d-904b-4d64-a9a3-ab381ca756e3 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:21:02.409901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-57117950-03d4-408f-9c43-b661126958a4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 404 len: 111 microversion: 2.20 time: 0.031374 Apr 05 11:21:02.413844 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 470/910] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:02 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:21:02.419296 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d008744d-41b2-4ce5-9310-6e7edff56064 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '.version_select at 0x7fec10868940>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:02.557507 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7da22161-5055-40e6-a005-8a7c3e6fb13f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:02.566723 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d008744d-41b2-4ce5-9310-6e7edff56064 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826705979" status: 204 len: 0 microversion: 2.20 time: 0.151502 Apr 05 11:21:02.574844 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 471/911] 10.222.0.39 () {60 vars in 1261 bytes} [Tue Apr 5 11:21:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1826705979 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 11:21:02.583165 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7da22161-5055-40e6-a005-8a7c3e6fb13f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1681 microversion: 2.1 time: 0.416507 Apr 05 11:21:02.594413 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 441/912] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:02 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1681 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:03.117136 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-86cefc2a-421a-4763-b50b-2046e388c5a2 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:03.129016 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-86cefc2a-421a-4763-b50b-2046e388c5a2 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:03.129873 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86cefc2a-421a-4763-b50b-2046e388c5a2 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:03.130115 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86cefc2a-421a-4763-b50b-2046e388c5a2 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:03.131145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86cefc2a-421a-4763-b50b-2046e388c5a2 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:03.131749 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86cefc2a-421a-4763-b50b-2046e388c5a2 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:03.170433 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-329effc0-d2d5-4ed8-99c7-8e0e3f9f3589 req-1b0c78fa-4f01-4d21-8797-e8d2cc31f9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e206c1c-372e-45c5-bb53-11d7ba0fb01f", "name": "network-vif-deleted", "tag": "f05746fb-fbaf-4f6f-a2a4-ac06ce53f6b6"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:03.187797 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-329effc0-d2d5-4ed8-99c7-8e0e3f9f3589 req-1b0c78fa-4f01-4d21-8797-e8d2cc31f9e5 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:03.189806 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-329effc0-d2d5-4ed8-99c7-8e0e3f9f3589 req-1b0c78fa-4f01-4d21-8797-e8d2cc31f9e5 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:03.209551 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-329effc0-d2d5-4ed8-99c7-8e0e3f9f3589 req-1b0c78fa-4f01-4d21-8797-e8d2cc31f9e5 service nova] Creating event network-vif-deleted:f05746fb-fbaf-4f6f-a2a4-ac06ce53f6b6 for instance 8e206c1c-372e-45c5-bb53-11d7ba0fb01f on hv-cinder-81899 Apr 05 11:21:03.226487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-329effc0-d2d5-4ed8-99c7-8e0e3f9f3589 req-1b0c78fa-4f01-4d21-8797-e8d2cc31f9e5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143493 Apr 05 11:21:03.226487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 472/913] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:21:03.448977 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-86cefc2a-421a-4763-b50b-2046e388c5a2 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:03.457033 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-86cefc2a-421a-4763-b50b-2046e388c5a2 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1276 microversion: 2.1 time: 0.344174 Apr 05 11:21:03.472683 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 442/914] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:03 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1276 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:03.601756 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0bbdf1b0-8263-4e9d-929e-1c44a49e935f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:03.602951 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0bbdf1b0-8263-4e9d-929e-1c44a49e935f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:03.609244 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0bbdf1b0-8263-4e9d-929e-1c44a49e935f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:03.609758 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0bbdf1b0-8263-4e9d-929e-1c44a49e935f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:03.610534 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0bbdf1b0-8263-4e9d-929e-1c44a49e935f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:03.611001 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0bbdf1b0-8263-4e9d-929e-1c44a49e935f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:03.641390 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0bbdf1b0-8263-4e9d-929e-1c44a49e935f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:03.641835 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0bbdf1b0-8263-4e9d-929e-1c44a49e935f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:03.642292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-0bbdf1b0-8263-4e9d-929e-1c44a49e935f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lazy-loading 'fault' on Instance uuid 8e206c1c-372e-45c5-bb53-11d7ba0fb01f {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:21:03.693063 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0bbdf1b0-8263-4e9d-929e-1c44a49e935f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:03.699666 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0bbdf1b0-8263-4e9d-929e-1c44a49e935f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 200 len: 1330 microversion: 2.1 time: 0.102192 Apr 05 11:21:03.700329 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 473/915] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:03 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:03.846429 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-33a3b2eb-6282-402b-bbfa-575a290a66c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Action: 'create', calling method: .version_select at 0x7fec06f29940>, body: {"keypair": {"name": "tempest-keypair-776424965"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:03.861648 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-33a3b2eb-6282-402b-bbfa-575a290a66c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Getting quotas for project ee45cad25b8c4845b2cf9c11ab2dd7c8. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:21:03.865739 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-33a3b2eb-6282-402b-bbfa-575a290a66c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Getting quotas for user 80261d844de047b18aa2ae70dbc3a4ec and project ee45cad25b8c4845b2cf9c11ab2dd7c8. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:21:04.074084 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-33a3b2eb-6282-402b-bbfa-575a290a66c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Getting quotas for project ee45cad25b8c4845b2cf9c11ab2dd7c8. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:21:04.078125 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-33a3b2eb-6282-402b-bbfa-575a290a66c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Getting quotas for user 80261d844de047b18aa2ae70dbc3a4ec and project ee45cad25b8c4845b2cf9c11ab2dd7c8. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:21:04.094735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-33a3b2eb-6282-402b-bbfa-575a290a66c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.252253 Apr 05 11:21:04.095349 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 443/916] 10.222.0.39 () {62 vars in 1198 bytes} [Tue Apr 5 11:21:03 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 254 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 05 11:21:04.473532 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ff3df0c5-0a28-40e3-b8ec-a882489141c9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:04.474159 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ff3df0c5-0a28-40e3-b8ec-a882489141c9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:04.481286 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff3df0c5-0a28-40e3-b8ec-a882489141c9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:04.487014 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff3df0c5-0a28-40e3-b8ec-a882489141c9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:04.487014 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff3df0c5-0a28-40e3-b8ec-a882489141c9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:04.487014 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ff3df0c5-0a28-40e3-b8ec-a882489141c9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:04.627491 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ff3df0c5-0a28-40e3-b8ec-a882489141c9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:04.634930 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ff3df0c5-0a28-40e3-b8ec-a882489141c9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1276 microversion: 2.1 time: 0.165234 Apr 05 11:21:04.635494 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 474/917] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:04 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:04.717542 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-afdc56fa-0b4c-4f99-8bf2-8d69bf5e7744 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:04.718153 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-afdc56fa-0b4c-4f99-8bf2-8d69bf5e7744 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:04.726013 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-afdc56fa-0b4c-4f99-8bf2-8d69bf5e7744 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:04.726499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-afdc56fa-0b4c-4f99-8bf2-8d69bf5e7744 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:04.727334 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-afdc56fa-0b4c-4f99-8bf2-8d69bf5e7744 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:04.728352 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-afdc56fa-0b4c-4f99-8bf2-8d69bf5e7744 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:04.742503 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-afdc56fa-0b4c-4f99-8bf2-8d69bf5e7744 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Instance 8e206c1c-372e-45c5-bb53-11d7ba0fb01f could not be found. Apr 05 11:21:04.743163 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-afdc56fa-0b4c-4f99-8bf2-8d69bf5e7744 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 404 to user: Instance 8e206c1c-372e-45c5-bb53-11d7ba0fb01f could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:21:04.743999 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-afdc56fa-0b4c-4f99-8bf2-8d69bf5e7744 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 404 len: 111 microversion: 2.1 time: 0.030489 Apr 05 11:21:04.744553 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 444/918] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:04 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:21:04.752979 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-76e8284c-dc1e-4628-8298-639113920eeb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '.version_select at 0x7fec1086b550>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:04.828699 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-76e8284c-dc1e-4628-8298-639113920eeb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-406291993" status: 202 len: 0 microversion: 2.1 time: 0.079510 Apr 05 11:21:04.829444 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 475/919] 10.222.0.39 () {58 vars in 1217 bytes} [Tue Apr 5 11:21:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-406291993 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:21:05.651311 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ac69aa52-3fff-457a-a84b-3240e72d8573 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:05.651918 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ac69aa52-3fff-457a-a84b-3240e72d8573 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:05.658915 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ac69aa52-3fff-457a-a84b-3240e72d8573 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:05.659788 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ac69aa52-3fff-457a-a84b-3240e72d8573 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:05.660590 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ac69aa52-3fff-457a-a84b-3240e72d8573 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:05.661674 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ac69aa52-3fff-457a-a84b-3240e72d8573 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:05.708441 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-25ce6716-38e9-4c1f-bb7e-2a85062fa65c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Action: 'create', calling method: .version_select at 0x7fec10876790>, body: {"keypair": {"name": "tempest-keypair-523744002"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:05.724720 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-25ce6716-38e9-4c1f-bb7e-2a85062fa65c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:21:05.730002 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-25ce6716-38e9-4c1f-bb7e-2a85062fa65c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for user 08f7e9cf075d43b39802bbdc58cd604f and project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:21:05.827978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ac69aa52-3fff-457a-a84b-3240e72d8573 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:05.844776 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ac69aa52-3fff-457a-a84b-3240e72d8573 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1276 microversion: 2.1 time: 0.197389 Apr 05 11:21:05.845425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 445/920] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:05 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:06.070768 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-25ce6716-38e9-4c1f-bb7e-2a85062fa65c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:21:06.074752 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-25ce6716-38e9-4c1f-bb7e-2a85062fa65c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for user 08f7e9cf075d43b39802bbdc58cd604f and project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:21:06.088622 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-25ce6716-38e9-4c1f-bb7e-2a85062fa65c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.384574 Apr 05 11:21:06.089241 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 476/921] 10.222.0.39 () {60 vars in 1157 bytes} [Tue Apr 5 11:21:05 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:06.863412 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c1363568-6063-49b5-a180-1357f9031a62 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:06.864839 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c1363568-6063-49b5-a180-1357f9031a62 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:06.872601 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1363568-6063-49b5-a180-1357f9031a62 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:06.873058 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1363568-6063-49b5-a180-1357f9031a62 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:06.873846 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1363568-6063-49b5-a180-1357f9031a62 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:06.874308 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1363568-6063-49b5-a180-1357f9031a62 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:07.051019 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c1363568-6063-49b5-a180-1357f9031a62 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:07.058506 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c1363568-6063-49b5-a180-1357f9031a62 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1276 microversion: 2.1 time: 0.200216 Apr 05 11:21:07.059123 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 446/922] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:06 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:07.089700 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-316554538", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c3ad901-dee6-4adf-8761-f4e0b40921d1"}], "security_groups": [{"name": "tempest-securitygroup--1879512536"}], "key_name": "tempest-keypair-776424965", "user_data": "}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:07.215559 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] validate_networks() for [('3c3ad901-dee6-4adf-8761-f4e0b40921d1', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:21:07.614738 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-279a897f-e553-41f8-bd79-0f11ea8ca9f6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:07.615761 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-279a897f-e553-41f8-bd79-0f11ea8ca9f6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:07.622509 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-279a897f-e553-41f8-bd79-0f11ea8ca9f6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:07.622999 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-279a897f-e553-41f8-bd79-0f11ea8ca9f6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:07.623795 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-279a897f-e553-41f8-bd79-0f11ea8ca9f6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:07.624230 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-279a897f-e553-41f8-bd79-0f11ea8ca9f6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:07.648895 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-279a897f-e553-41f8-bd79-0f11ea8ca9f6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lazy-loading 'flavor' on Instance uuid 0d7680ed-da15-498a-a57d-a37e492ada5b {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:21:07.787237 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:21:07.787793 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:21:07.788395 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:21:07.788931 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:21:07.789613 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:21:07.799196 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:07.799648 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:07.800452 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:07.800932 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:07.817654 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Getting quotas for project ee45cad25b8c4845b2cf9c11ab2dd7c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:21:07.821751 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Getting quotas for user 80261d844de047b18aa2ae70dbc3a4ec and project ee45cad25b8c4845b2cf9c11ab2dd7c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:21:07.833762 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:21:07.836236 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:21:08.069555 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-41d5ce63-262e-4994-bcfd-4248e6b6e783 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.988299 Apr 05 11:21:08.070379 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 477/923] 10.222.0.39 () {62 vars in 1187 bytes} [Tue Apr 5 11:21:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 05 11:21:08.089521 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e0d929d9-8bf9-435c-9124-69d8cf9e907c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:08.090537 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e0d929d9-8bf9-435c-9124-69d8cf9e907c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:08.100282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e0d929d9-8bf9-435c-9124-69d8cf9e907c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:08.100282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e0d929d9-8bf9-435c-9124-69d8cf9e907c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:08.101286 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e0d929d9-8bf9-435c-9124-69d8cf9e907c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:08.101412 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e0d929d9-8bf9-435c-9124-69d8cf9e907c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:08.135474 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-279a897f-e553-41f8-bd79-0f11ea8ca9f6 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "POST /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/action" status: 200 len: 32 microversion: 2.1 time: 0.523725 Apr 05 11:21:08.136703 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 447/924] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:21:07 2022] POST /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/action => generated 32 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 05 11:21:08.150548 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f5f2e1c4-9e0d-4841-a71d-168feffb534a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:08.152302 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f5f2e1c4-9e0d-4841-a71d-168feffb534a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:08.300754 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f5f2e1c4-9e0d-4841-a71d-168feffb534a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:08.335412 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f5f2e1c4-9e0d-4841-a71d-168feffb534a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:08.339377 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e0d929d9-8bf9-435c-9124-69d8cf9e907c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:08.343534 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f5f2e1c4-9e0d-4841-a71d-168feffb534a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:08.346155 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f5f2e1c4-9e0d-4841-a71d-168feffb534a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1280 microversion: 2.20 time: 0.205167 Apr 05 11:21:08.348076 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 448/925] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:08 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1280 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:08.348404 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e0d929d9-8bf9-435c-9124-69d8cf9e907c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1276 microversion: 2.1 time: 0.266180 Apr 05 11:21:08.354686 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 478/926] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:08 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1276 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:08.371750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-00407445-92ed-420a-8224-5a0b7ef8e45d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:08.373052 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-00407445-92ed-420a-8224-5a0b7ef8e45d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:08.386295 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00407445-92ed-420a-8224-5a0b7ef8e45d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:08.387162 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00407445-92ed-420a-8224-5a0b7ef8e45d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:08.388542 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00407445-92ed-420a-8224-5a0b7ef8e45d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:08.389424 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00407445-92ed-420a-8224-5a0b7ef8e45d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:08.692295 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-00407445-92ed-420a-8224-5a0b7ef8e45d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:08.701682 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-00407445-92ed-420a-8224-5a0b7ef8e45d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.345802 Apr 05 11:21:08.712604 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 449/927] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:08 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:09.374228 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b8a0cc92-a09c-4a6e-8197-7f09fb245a17 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:09.380675 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-528799ce-fa4b-49e8-bbd9-10d0ed5d1844 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:09.381356 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-528799ce-fa4b-49e8-bbd9-10d0ed5d1844 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:09.385951 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b8a0cc92-a09c-4a6e-8197-7f09fb245a17 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:09.393673 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-528799ce-fa4b-49e8-bbd9-10d0ed5d1844 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:09.394101 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-528799ce-fa4b-49e8-bbd9-10d0ed5d1844 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:09.394271 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b8a0cc92-a09c-4a6e-8197-7f09fb245a17 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:09.394581 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b8a0cc92-a09c-4a6e-8197-7f09fb245a17 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:09.395535 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b8a0cc92-a09c-4a6e-8197-7f09fb245a17 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:09.395759 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-528799ce-fa4b-49e8-bbd9-10d0ed5d1844 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:09.396106 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b8a0cc92-a09c-4a6e-8197-7f09fb245a17 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:09.396680 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-528799ce-fa4b-49e8-bbd9-10d0ed5d1844 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:09.469268 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b8a0cc92-a09c-4a6e-8197-7f09fb245a17 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:09.477968 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b8a0cc92-a09c-4a6e-8197-7f09fb245a17 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:09.479626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b8a0cc92-a09c-4a6e-8197-7f09fb245a17 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:09.480766 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b8a0cc92-a09c-4a6e-8197-7f09fb245a17 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1284 microversion: 2.20 time: 0.111340 Apr 05 11:21:09.481343 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 479/928] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:09 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:21:09.709149 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-528799ce-fa4b-49e8-bbd9-10d0ed5d1844 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:09.717256 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-528799ce-fa4b-49e8-bbd9-10d0ed5d1844 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.341357 Apr 05 11:21:09.717836 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 450/929] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:09 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:09.720350 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e16d5b26-d7b8-4ff5-a1d4-20ebf38f7cb8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:09.720993 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e16d5b26-d7b8-4ff5-a1d4-20ebf38f7cb8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:09.728296 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e16d5b26-d7b8-4ff5-a1d4-20ebf38f7cb8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:09.730955 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e16d5b26-d7b8-4ff5-a1d4-20ebf38f7cb8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:09.730955 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e16d5b26-d7b8-4ff5-a1d4-20ebf38f7cb8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:09.730955 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e16d5b26-d7b8-4ff5-a1d4-20ebf38f7cb8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:09.881488 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e16d5b26-d7b8-4ff5-a1d4-20ebf38f7cb8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:09.890762 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e16d5b26-d7b8-4ff5-a1d4-20ebf38f7cb8 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.174624 Apr 05 11:21:09.891479 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 480/930] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:09 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:10.079072 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1208788964", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61947bc0-bf95-4d84-a95a-a866833cbe78"}], "security_groups": [{"name": "tempest-securitygroup--1737862376"}], "key_name": "tempest-keypair-523744002", "user_data": "}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:10.190903 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] validate_networks() for [('61947bc0-bf95-4d84-a95a-a866833cbe78', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:21:10.499858 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-109f11d6-add0-47f2-8308-7f81d9275b85 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:10.500505 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-109f11d6-add0-47f2-8308-7f81d9275b85 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:10.507149 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-109f11d6-add0-47f2-8308-7f81d9275b85 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:10.507629 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-109f11d6-add0-47f2-8308-7f81d9275b85 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:10.508889 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-109f11d6-add0-47f2-8308-7f81d9275b85 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:10.509325 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-109f11d6-add0-47f2-8308-7f81d9275b85 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:10.575567 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-109f11d6-add0-47f2-8308-7f81d9275b85 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:10.583663 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-109f11d6-add0-47f2-8308-7f81d9275b85 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:10.585161 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-109f11d6-add0-47f2-8308-7f81d9275b85 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:10.586250 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-109f11d6-add0-47f2-8308-7f81d9275b85 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1284 microversion: 2.20 time: 0.090529 Apr 05 11:21:10.587399 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 481/931] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:10 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:21:10.598515 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:21:10.599008 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:21:10.599195 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:21:10.599853 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:21:10.600274 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:21:10.609142 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:10.609597 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:10.610406 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:10.610881 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:10.627177 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:21:10.631531 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for user 08f7e9cf075d43b39802bbdc58cd604f and project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:21:10.642754 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:21:10.645040 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:21:10.739330 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-19548dea-0c53-4932-a349-dc86aaa6103f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:10.739943 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-19548dea-0c53-4932-a349-dc86aaa6103f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:10.746676 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-19548dea-0c53-4932-a349-dc86aaa6103f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:10.747176 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-19548dea-0c53-4932-a349-dc86aaa6103f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:10.747953 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-19548dea-0c53-4932-a349-dc86aaa6103f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:10.748421 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-19548dea-0c53-4932-a349-dc86aaa6103f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:10.829353 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ccb5cbd3-ec2e-4a95-b287-d09a5d170889 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.754730 Apr 05 11:21:10.829908 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 451/932] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:21:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:21:10.840559 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0863206f-604d-4b2e-9f6d-c8767c3d7950 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:10.841253 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0863206f-604d-4b2e-9f6d-c8767c3d7950 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:10.896199 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0863206f-604d-4b2e-9f6d-c8767c3d7950 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:10.901611 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-19548dea-0c53-4932-a349-dc86aaa6103f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:10.906056 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0863206f-604d-4b2e-9f6d-c8767c3d7950 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1241 microversion: 2.1 time: 0.069284 Apr 05 11:21:10.916475 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 452/933] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:10 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:10.916690 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-19548dea-0c53-4932-a349-dc86aaa6103f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.176944 Apr 05 11:21:10.916690 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 482/934] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:10 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:10.920579 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d109ddf7-e60a-405d-abe4-1e3f92a12e4f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:10.921329 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d109ddf7-e60a-405d-abe4-1e3f92a12e4f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:10.927492 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d109ddf7-e60a-405d-abe4-1e3f92a12e4f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:10.928075 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d109ddf7-e60a-405d-abe4-1e3f92a12e4f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:10.929152 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d109ddf7-e60a-405d-abe4-1e3f92a12e4f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:10.929501 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d109ddf7-e60a-405d-abe4-1e3f92a12e4f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:11.065360 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d109ddf7-e60a-405d-abe4-1e3f92a12e4f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:11.073704 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d109ddf7-e60a-405d-abe4-1e3f92a12e4f tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.164585 Apr 05 11:21:11.074271 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 453/935] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:10 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:11.604884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2a3439ba-18da-4623-8d80-8f778ec2c55f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:11.605504 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2a3439ba-18da-4623-8d80-8f778ec2c55f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:11.611928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2a3439ba-18da-4623-8d80-8f778ec2c55f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:11.612403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2a3439ba-18da-4623-8d80-8f778ec2c55f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:11.614560 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2a3439ba-18da-4623-8d80-8f778ec2c55f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:11.614560 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2a3439ba-18da-4623-8d80-8f778ec2c55f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:11.687521 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2a3439ba-18da-4623-8d80-8f778ec2c55f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:11.695959 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2a3439ba-18da-4623-8d80-8f778ec2c55f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:11.699277 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2a3439ba-18da-4623-8d80-8f778ec2c55f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:11.699277 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2a3439ba-18da-4623-8d80-8f778ec2c55f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1340 microversion: 2.20 time: 0.098538 Apr 05 11:21:11.699641 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 483/936] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:11 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1340 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:11.924409 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b9b31775-6cba-4340-a875-0d5b2e49bb8f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:11.925150 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b9b31775-6cba-4340-a875-0d5b2e49bb8f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:11.929086 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3bfdc212-9cdc-4e36-97b6-851b29dcea8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:11.929700 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3bfdc212-9cdc-4e36-97b6-851b29dcea8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:11.935702 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bfdc212-9cdc-4e36-97b6-851b29dcea8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:11.936121 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bfdc212-9cdc-4e36-97b6-851b29dcea8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:11.936940 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bfdc212-9cdc-4e36-97b6-851b29dcea8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:11.937369 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bfdc212-9cdc-4e36-97b6-851b29dcea8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:11.981540 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b9b31775-6cba-4340-a875-0d5b2e49bb8f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:11.993472 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b9b31775-6cba-4340-a875-0d5b2e49bb8f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1241 microversion: 2.1 time: 0.072814 Apr 05 11:21:12.018661 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 454/937] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:11 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:12.091395 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-db0e8af1-35a1-4fe3-9d38-4f1a35430a2d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:12.101502 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-db0e8af1-35a1-4fe3-9d38-4f1a35430a2d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:12.101502 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-db0e8af1-35a1-4fe3-9d38-4f1a35430a2d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:12.101502 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-db0e8af1-35a1-4fe3-9d38-4f1a35430a2d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:12.101502 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-db0e8af1-35a1-4fe3-9d38-4f1a35430a2d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:12.101973 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-db0e8af1-35a1-4fe3-9d38-4f1a35430a2d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:12.189342 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3bfdc212-9cdc-4e36-97b6-851b29dcea8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:12.197382 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3bfdc212-9cdc-4e36-97b6-851b29dcea8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.272098 Apr 05 11:21:12.197957 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 484/938] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:11 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:12.241656 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-db0e8af1-35a1-4fe3-9d38-4f1a35430a2d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:12.250068 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-db0e8af1-35a1-4fe3-9d38-4f1a35430a2d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.162446 Apr 05 11:21:12.250665 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 455/939] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:12 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:12.720446 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d112eec2-d773-4f70-abdc-e5357d5e7016 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:12.721354 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d112eec2-d773-4f70-abdc-e5357d5e7016 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:12.729672 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d112eec2-d773-4f70-abdc-e5357d5e7016 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:12.733413 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d112eec2-d773-4f70-abdc-e5357d5e7016 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:12.733413 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d112eec2-d773-4f70-abdc-e5357d5e7016 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:12.733413 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d112eec2-d773-4f70-abdc-e5357d5e7016 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:13.013325 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d112eec2-d773-4f70-abdc-e5357d5e7016 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:13.021616 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d112eec2-d773-4f70-abdc-e5357d5e7016 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:13.025675 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d112eec2-d773-4f70-abdc-e5357d5e7016 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:13.029203 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d719dd96-bdc4-45a4-93d8-bbac29fccc2c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:13.029745 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d112eec2-d773-4f70-abdc-e5357d5e7016 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1406 microversion: 2.20 time: 0.310431 Apr 05 11:21:13.029983 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d719dd96-bdc4-45a4-93d8-bbac29fccc2c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:13.036317 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d719dd96-bdc4-45a4-93d8-bbac29fccc2c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:13.036771 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d719dd96-bdc4-45a4-93d8-bbac29fccc2c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:13.037549 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d719dd96-bdc4-45a4-93d8-bbac29fccc2c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:13.037983 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d719dd96-bdc4-45a4-93d8-bbac29fccc2c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:13.041946 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 485/940] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:12 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:13.097943 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d719dd96-bdc4-45a4-93d8-bbac29fccc2c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:13.106002 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d719dd96-bdc4-45a4-93d8-bbac29fccc2c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1293 microversion: 2.1 time: 0.080705 Apr 05 11:21:13.108453 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 456/941] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:13 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:13.214359 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e32b0bc5-5272-4bb2-be20-b1def60c0e76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:13.214983 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e32b0bc5-5272-4bb2-be20-b1def60c0e76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:13.220819 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e32b0bc5-5272-4bb2-be20-b1def60c0e76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:13.223328 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e32b0bc5-5272-4bb2-be20-b1def60c0e76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:13.223328 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e32b0bc5-5272-4bb2-be20-b1def60c0e76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:13.223328 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e32b0bc5-5272-4bb2-be20-b1def60c0e76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:13.269105 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d6e47f9d-0ca2-4419-97a8-cbc26cf2d795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:13.269967 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d6e47f9d-0ca2-4419-97a8-cbc26cf2d795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:13.277005 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d6e47f9d-0ca2-4419-97a8-cbc26cf2d795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:13.277706 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d6e47f9d-0ca2-4419-97a8-cbc26cf2d795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:13.278525 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d6e47f9d-0ca2-4419-97a8-cbc26cf2d795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:13.278998 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d6e47f9d-0ca2-4419-97a8-cbc26cf2d795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:13.442497 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d6e47f9d-0ca2-4419-97a8-cbc26cf2d795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:13.451856 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d6e47f9d-0ca2-4419-97a8-cbc26cf2d795 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.187569 Apr 05 11:21:13.452579 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 457/942] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:13 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:13.477267 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e32b0bc5-5272-4bb2-be20-b1def60c0e76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:13.496072 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e32b0bc5-5272-4bb2-be20-b1def60c0e76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.285907 Apr 05 11:21:13.497274 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 486/943] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:13 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:13.693139 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-d34808c3-7e4a-4155-aedc-d71a7f25a528 req-ee4bcb6f-95fb-4763-bb2a-8d12f5a03112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "078668ec-0695-4717-bef7-1153cdc2dd14", "tag": "f631937a-090e-4c88-959c-bbf9308dfac9"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:13.703383 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-d34808c3-7e4a-4155-aedc-d71a7f25a528 req-ee4bcb6f-95fb-4763-bb2a-8d12f5a03112 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:13.703383 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-d34808c3-7e4a-4155-aedc-d71a7f25a528 req-ee4bcb6f-95fb-4763-bb2a-8d12f5a03112 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:13.717881 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-d34808c3-7e4a-4155-aedc-d71a7f25a528 req-ee4bcb6f-95fb-4763-bb2a-8d12f5a03112 service nova] Creating event network-changed:f631937a-090e-4c88-959c-bbf9308dfac9 for instance 078668ec-0695-4717-bef7-1153cdc2dd14 on hv-cinder-81899 Apr 05 11:21:13.725443 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-d34808c3-7e4a-4155-aedc-d71a7f25a528 req-ee4bcb6f-95fb-4763-bb2a-8d12f5a03112 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035778 Apr 05 11:21:13.726388 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 458/944] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:21:14.048487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a84c52b9-2d23-4155-8ebc-47c136cc30ca tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:14.049112 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a84c52b9-2d23-4155-8ebc-47c136cc30ca tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:14.056638 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a84c52b9-2d23-4155-8ebc-47c136cc30ca tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:14.057099 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a84c52b9-2d23-4155-8ebc-47c136cc30ca tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:14.071828 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a84c52b9-2d23-4155-8ebc-47c136cc30ca tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:14.071828 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a84c52b9-2d23-4155-8ebc-47c136cc30ca tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:14.124424 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-73ecb9fe-4e0f-4f80-b95e-8e3b026ffa80 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:14.125699 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-73ecb9fe-4e0f-4f80-b95e-8e3b026ffa80 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:14.132567 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73ecb9fe-4e0f-4f80-b95e-8e3b026ffa80 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:14.133012 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73ecb9fe-4e0f-4f80-b95e-8e3b026ffa80 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:14.133823 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73ecb9fe-4e0f-4f80-b95e-8e3b026ffa80 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:14.134401 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73ecb9fe-4e0f-4f80-b95e-8e3b026ffa80 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:14.215347 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-73ecb9fe-4e0f-4f80-b95e-8e3b026ffa80 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:14.218493 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-73ecb9fe-4e0f-4f80-b95e-8e3b026ffa80 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1299 microversion: 2.1 time: 0.098257 Apr 05 11:21:14.219137 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 459/945] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:14 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:14.303136 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a84c52b9-2d23-4155-8ebc-47c136cc30ca tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:14.310928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a84c52b9-2d23-4155-8ebc-47c136cc30ca tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:14.313087 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a84c52b9-2d23-4155-8ebc-47c136cc30ca tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:14.313574 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a84c52b9-2d23-4155-8ebc-47c136cc30ca tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1406 microversion: 2.20 time: 0.269321 Apr 05 11:21:14.314135 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 487/946] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:14 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:14.470674 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5f9006a6-8660-4ec1-a582-2bf10944b9d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:14.471549 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5f9006a6-8660-4ec1-a582-2bf10944b9d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:14.479508 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f9006a6-8660-4ec1-a582-2bf10944b9d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:14.480059 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f9006a6-8660-4ec1-a582-2bf10944b9d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:14.481122 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f9006a6-8660-4ec1-a582-2bf10944b9d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:14.481795 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f9006a6-8660-4ec1-a582-2bf10944b9d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:14.512457 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1a587226-ca38-46a4-a5f9-0d37da31835b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:14.513471 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1a587226-ca38-46a4-a5f9-0d37da31835b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:14.527279 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a587226-ca38-46a4-a5f9-0d37da31835b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:14.527717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a587226-ca38-46a4-a5f9-0d37da31835b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:14.528564 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a587226-ca38-46a4-a5f9-0d37da31835b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:14.531149 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a587226-ca38-46a4-a5f9-0d37da31835b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:14.702069 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1a587226-ca38-46a4-a5f9-0d37da31835b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:14.708210 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5f9006a6-8660-4ec1-a582-2bf10944b9d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:14.716065 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1a587226-ca38-46a4-a5f9-0d37da31835b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.207569 Apr 05 11:21:14.716738 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 488/947] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:14 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:14.721403 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5f9006a6-8660-4ec1-a582-2bf10944b9d0 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.255937 Apr 05 11:21:14.721967 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 460/948] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:14 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:15.237376 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6bf2f1a2-c9a6-4480-acbd-61694d2bb321 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:15.238151 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6bf2f1a2-c9a6-4480-acbd-61694d2bb321 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:15.245888 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6bf2f1a2-c9a6-4480-acbd-61694d2bb321 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:15.246479 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6bf2f1a2-c9a6-4480-acbd-61694d2bb321 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:15.247373 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6bf2f1a2-c9a6-4480-acbd-61694d2bb321 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:15.247921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6bf2f1a2-c9a6-4480-acbd-61694d2bb321 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:15.331692 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d79755f6-abfb-49ea-a45c-23d666401e9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:15.332298 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d79755f6-abfb-49ea-a45c-23d666401e9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:15.339255 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d79755f6-abfb-49ea-a45c-23d666401e9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:15.339711 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d79755f6-abfb-49ea-a45c-23d666401e9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:15.340498 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d79755f6-abfb-49ea-a45c-23d666401e9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:15.340943 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d79755f6-abfb-49ea-a45c-23d666401e9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:15.386647 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6bf2f1a2-c9a6-4480-acbd-61694d2bb321 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:15.394371 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6bf2f1a2-c9a6-4480-acbd-61694d2bb321 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1367 microversion: 2.1 time: 0.161436 Apr 05 11:21:15.395052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 489/949] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:15 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:15.452048 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-e7daf4fc-d0f8-404e-88b8-ce71b8bf640e req-58d3ed8b-061e-4b73-834e-9b60909a5015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb84f3b-18ce-4112-96a8-e6c729c759d2", "tag": "ff329987-a622-46de-9587-bacbc941bd71"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:15.462698 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-e7daf4fc-d0f8-404e-88b8-ce71b8bf640e req-58d3ed8b-061e-4b73-834e-9b60909a5015 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:15.463244 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-e7daf4fc-d0f8-404e-88b8-ce71b8bf640e req-58d3ed8b-061e-4b73-834e-9b60909a5015 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:15.476082 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-e7daf4fc-d0f8-404e-88b8-ce71b8bf640e req-58d3ed8b-061e-4b73-834e-9b60909a5015 service nova] Creating event network-changed:ff329987-a622-46de-9587-bacbc941bd71 for instance 1eb84f3b-18ce-4112-96a8-e6c729c759d2 on hv-cinder-81899 Apr 05 11:21:15.483545 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-e7daf4fc-d0f8-404e-88b8-ce71b8bf640e req-58d3ed8b-061e-4b73-834e-9b60909a5015 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035506 Apr 05 11:21:15.484327 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 490/950] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:21:15.556846 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d79755f6-abfb-49ea-a45c-23d666401e9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:15.565090 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d79755f6-abfb-49ea-a45c-23d666401e9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:15.566912 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d79755f6-abfb-49ea-a45c-23d666401e9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:15.568177 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d79755f6-abfb-49ea-a45c-23d666401e9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1406 microversion: 2.20 time: 0.240654 Apr 05 11:21:15.568744 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 461/951] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:15 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:21:15.733435 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-60e792b8-66ba-4396-964b-cb223572eef0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:15.734062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-60e792b8-66ba-4396-964b-cb223572eef0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:15.738882 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-492e99d4-1dcf-40f1-9500-fb7f7753d523 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:15.739501 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-492e99d4-1dcf-40f1-9500-fb7f7753d523 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:15.741173 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-60e792b8-66ba-4396-964b-cb223572eef0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:15.741620 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-60e792b8-66ba-4396-964b-cb223572eef0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:15.742380 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-60e792b8-66ba-4396-964b-cb223572eef0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:15.742870 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-60e792b8-66ba-4396-964b-cb223572eef0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:15.745285 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-492e99d4-1dcf-40f1-9500-fb7f7753d523 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:15.745731 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-492e99d4-1dcf-40f1-9500-fb7f7753d523 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:15.746499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-492e99d4-1dcf-40f1-9500-fb7f7753d523 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:15.746958 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-492e99d4-1dcf-40f1-9500-fb7f7753d523 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:15.878145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-492e99d4-1dcf-40f1-9500-fb7f7753d523 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:15.879117 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-60e792b8-66ba-4396-964b-cb223572eef0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:15.886743 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-492e99d4-1dcf-40f1-9500-fb7f7753d523 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.151821 Apr 05 11:21:15.887030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-60e792b8-66ba-4396-964b-cb223572eef0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.157909 Apr 05 11:21:15.887265 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 462/952] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:15 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:15.887658 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 491/953] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:15 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:16.411610 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-121d90cc-185b-46f5-aba9-f753814cb4e9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:16.412215 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-121d90cc-185b-46f5-aba9-f753814cb4e9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:16.419237 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-121d90cc-185b-46f5-aba9-f753814cb4e9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:16.419683 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-121d90cc-185b-46f5-aba9-f753814cb4e9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:16.420444 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-121d90cc-185b-46f5-aba9-f753814cb4e9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:16.420876 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-121d90cc-185b-46f5-aba9-f753814cb4e9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:16.561505 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-121d90cc-185b-46f5-aba9-f753814cb4e9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:16.569002 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-121d90cc-185b-46f5-aba9-f753814cb4e9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1367 microversion: 2.1 time: 0.161291 Apr 05 11:21:16.569572 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 463/954] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:16 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:16.586471 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4e80cda3-a452-4809-a304-3f650f6a774f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:16.587111 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4e80cda3-a452-4809-a304-3f650f6a774f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:16.593432 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4e80cda3-a452-4809-a304-3f650f6a774f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:16.593886 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4e80cda3-a452-4809-a304-3f650f6a774f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:16.594680 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4e80cda3-a452-4809-a304-3f650f6a774f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:16.595157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4e80cda3-a452-4809-a304-3f650f6a774f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:16.730590 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4e80cda3-a452-4809-a304-3f650f6a774f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:16.738596 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4e80cda3-a452-4809-a304-3f650f6a774f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:16.740144 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4e80cda3-a452-4809-a304-3f650f6a774f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:16.741237 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4e80cda3-a452-4809-a304-3f650f6a774f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1406 microversion: 2.20 time: 0.158836 Apr 05 11:21:16.741795 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 492/955] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:16 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:16.904263 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-14ab065b-62b0-43c4-b9f3-501939ddda5a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:16.904565 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fc912f70-7b3b-4122-902b-746f8cfc290c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:16.904903 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-14ab065b-62b0-43c4-b9f3-501939ddda5a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:16.905234 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fc912f70-7b3b-4122-902b-746f8cfc290c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:16.911281 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-14ab065b-62b0-43c4-b9f3-501939ddda5a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:16.911690 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc912f70-7b3b-4122-902b-746f8cfc290c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:16.911820 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-14ab065b-62b0-43c4-b9f3-501939ddda5a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:16.912136 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc912f70-7b3b-4122-902b-746f8cfc290c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:16.912507 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-14ab065b-62b0-43c4-b9f3-501939ddda5a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:16.912896 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc912f70-7b3b-4122-902b-746f8cfc290c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:16.913013 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-14ab065b-62b0-43c4-b9f3-501939ddda5a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:16.913325 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc912f70-7b3b-4122-902b-746f8cfc290c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:17.055630 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fc912f70-7b3b-4122-902b-746f8cfc290c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:17.055792 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-14ab065b-62b0-43c4-b9f3-501939ddda5a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:17.060924 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fc912f70-7b3b-4122-902b-746f8cfc290c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.160093 Apr 05 11:21:17.061806 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 493/956] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:16 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:17.062463 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-14ab065b-62b0-43c4-b9f3-501939ddda5a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.162132 Apr 05 11:21:17.063179 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 464/957] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:16 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:17.585300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8db63a98-d0fb-4a16-a82a-7ce26d6abeeb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:17.585834 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8db63a98-d0fb-4a16-a82a-7ce26d6abeeb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:17.593838 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8db63a98-d0fb-4a16-a82a-7ce26d6abeeb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:17.594624 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8db63a98-d0fb-4a16-a82a-7ce26d6abeeb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:17.595746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8db63a98-d0fb-4a16-a82a-7ce26d6abeeb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:17.596194 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8db63a98-d0fb-4a16-a82a-7ce26d6abeeb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:17.728365 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8db63a98-d0fb-4a16-a82a-7ce26d6abeeb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:17.735607 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8db63a98-d0fb-4a16-a82a-7ce26d6abeeb tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1367 microversion: 2.1 time: 0.154407 Apr 05 11:21:17.736173 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 494/958] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:17 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:17.759460 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4a1a0e10-3523-42b8-b257-edeb06146a08 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:17.760075 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4a1a0e10-3523-42b8-b257-edeb06146a08 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:17.766426 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4a1a0e10-3523-42b8-b257-edeb06146a08 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:17.766910 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4a1a0e10-3523-42b8-b257-edeb06146a08 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:17.767741 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4a1a0e10-3523-42b8-b257-edeb06146a08 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:17.768178 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4a1a0e10-3523-42b8-b257-edeb06146a08 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:17.902571 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4a1a0e10-3523-42b8-b257-edeb06146a08 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:17.910237 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4a1a0e10-3523-42b8-b257-edeb06146a08 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:17.911775 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4a1a0e10-3523-42b8-b257-edeb06146a08 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:17.912864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4a1a0e10-3523-42b8-b257-edeb06146a08 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1406 microversion: 2.20 time: 0.157909 Apr 05 11:21:17.913472 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 465/959] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:17 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:21:18.078934 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1dfb7cb8-6732-4a58-9694-fa71979892ad tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:18.079205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-81664c53-2229-4b68-bf09-e2f29cb3d3fc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:18.079551 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1dfb7cb8-6732-4a58-9694-fa71979892ad tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:18.079838 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-81664c53-2229-4b68-bf09-e2f29cb3d3fc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:18.085825 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1dfb7cb8-6732-4a58-9694-fa71979892ad tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:18.086015 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-81664c53-2229-4b68-bf09-e2f29cb3d3fc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:18.086951 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1dfb7cb8-6732-4a58-9694-fa71979892ad tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:18.087080 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-81664c53-2229-4b68-bf09-e2f29cb3d3fc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:18.087721 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1dfb7cb8-6732-4a58-9694-fa71979892ad tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:18.087829 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-81664c53-2229-4b68-bf09-e2f29cb3d3fc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:18.088157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1dfb7cb8-6732-4a58-9694-fa71979892ad tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:18.088261 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-81664c53-2229-4b68-bf09-e2f29cb3d3fc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:18.222069 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1dfb7cb8-6732-4a58-9694-fa71979892ad tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:18.223289 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-81664c53-2229-4b68-bf09-e2f29cb3d3fc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:18.230080 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1dfb7cb8-6732-4a58-9694-fa71979892ad tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.155034 Apr 05 11:21:18.230536 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-81664c53-2229-4b68-bf09-e2f29cb3d3fc tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.155180 Apr 05 11:21:18.230726 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 495/960] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:18 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:18.231117 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 466/961] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:18 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:18.752999 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5425a733-209a-48b4-8692-80b8eec2443b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:18.753697 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5425a733-209a-48b4-8692-80b8eec2443b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:18.762325 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5425a733-209a-48b4-8692-80b8eec2443b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:18.762914 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5425a733-209a-48b4-8692-80b8eec2443b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:18.763816 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5425a733-209a-48b4-8692-80b8eec2443b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:18.764288 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5425a733-209a-48b4-8692-80b8eec2443b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:18.899730 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5425a733-209a-48b4-8692-80b8eec2443b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:18.908930 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5425a733-209a-48b4-8692-80b8eec2443b tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1367 microversion: 2.1 time: 0.159802 Apr 05 11:21:18.918046 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 496/962] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:18 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:18.933052 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cffad8fd-60d4-41f1-9a2f-ad326e177871 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:18.934312 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cffad8fd-60d4-41f1-9a2f-ad326e177871 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:18.943539 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cffad8fd-60d4-41f1-9a2f-ad326e177871 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:18.943997 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cffad8fd-60d4-41f1-9a2f-ad326e177871 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:18.945084 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cffad8fd-60d4-41f1-9a2f-ad326e177871 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:18.945434 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cffad8fd-60d4-41f1-9a2f-ad326e177871 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:19.129857 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cffad8fd-60d4-41f1-9a2f-ad326e177871 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:19.137830 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cffad8fd-60d4-41f1-9a2f-ad326e177871 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:19.139385 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cffad8fd-60d4-41f1-9a2f-ad326e177871 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:19.140484 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cffad8fd-60d4-41f1-9a2f-ad326e177871 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1406 microversion: 2.20 time: 0.213525 Apr 05 11:21:19.141048 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 467/963] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:18 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:19.247594 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6057ec79-e5e5-491c-8769-9817ee198738 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:19.252861 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c73767e4-c0a0-402e-b0ec-b8015f692067 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:19.253081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6057ec79-e5e5-491c-8769-9817ee198738 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:19.253225 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c73767e4-c0a0-402e-b0ec-b8015f692067 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:19.254519 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6057ec79-e5e5-491c-8769-9817ee198738 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:19.254761 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c73767e4-c0a0-402e-b0ec-b8015f692067 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:19.255029 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6057ec79-e5e5-491c-8769-9817ee198738 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:19.255351 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c73767e4-c0a0-402e-b0ec-b8015f692067 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:19.255938 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6057ec79-e5e5-491c-8769-9817ee198738 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:19.256255 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c73767e4-c0a0-402e-b0ec-b8015f692067 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:19.256409 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6057ec79-e5e5-491c-8769-9817ee198738 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:19.257056 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c73767e4-c0a0-402e-b0ec-b8015f692067 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:19.408524 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6057ec79-e5e5-491c-8769-9817ee198738 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:19.413179 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c73767e4-c0a0-402e-b0ec-b8015f692067 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:19.417001 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6057ec79-e5e5-491c-8769-9817ee198738 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.173086 Apr 05 11:21:19.418645 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 497/964] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:19 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:19.422260 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c73767e4-c0a0-402e-b0ec-b8015f692067 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.178589 Apr 05 11:21:19.422858 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 468/965] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:19 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:19.926257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2603e65e-07cf-4f49-b8a5-c50bcb23b1b9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:19.926901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2603e65e-07cf-4f49-b8a5-c50bcb23b1b9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:19.933378 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2603e65e-07cf-4f49-b8a5-c50bcb23b1b9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:19.933823 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2603e65e-07cf-4f49-b8a5-c50bcb23b1b9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:19.934579 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2603e65e-07cf-4f49-b8a5-c50bcb23b1b9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:19.935041 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2603e65e-07cf-4f49-b8a5-c50bcb23b1b9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:20.063813 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2603e65e-07cf-4f49-b8a5-c50bcb23b1b9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:20.071817 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2603e65e-07cf-4f49-b8a5-c50bcb23b1b9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1367 microversion: 2.1 time: 0.149317 Apr 05 11:21:20.072320 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 498/966] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:19 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:20.158962 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eeedc94c-9848-412d-a2d5-c25a5282002e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:20.159509 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eeedc94c-9848-412d-a2d5-c25a5282002e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:20.166310 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eeedc94c-9848-412d-a2d5-c25a5282002e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:20.166790 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eeedc94c-9848-412d-a2d5-c25a5282002e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:20.167551 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eeedc94c-9848-412d-a2d5-c25a5282002e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:20.167979 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eeedc94c-9848-412d-a2d5-c25a5282002e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:20.300364 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eeedc94c-9848-412d-a2d5-c25a5282002e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:20.308600 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eeedc94c-9848-412d-a2d5-c25a5282002e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:20.310092 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eeedc94c-9848-412d-a2d5-c25a5282002e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:20.311201 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eeedc94c-9848-412d-a2d5-c25a5282002e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1406 microversion: 2.20 time: 0.156437 Apr 05 11:21:20.311765 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 469/967] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:20 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:20.435414 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6764e89b-1128-4c61-b854-4ab977415912 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:20.435962 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6764e89b-1128-4c61-b854-4ab977415912 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:20.439380 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c6f21575-2f2a-4f7b-bfe9-2caff893fc7a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:20.440015 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c6f21575-2f2a-4f7b-bfe9-2caff893fc7a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:20.442085 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6764e89b-1128-4c61-b854-4ab977415912 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:20.442537 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6764e89b-1128-4c61-b854-4ab977415912 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:20.443341 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6764e89b-1128-4c61-b854-4ab977415912 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:20.443780 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6764e89b-1128-4c61-b854-4ab977415912 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:20.445753 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6f21575-2f2a-4f7b-bfe9-2caff893fc7a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:20.446200 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6f21575-2f2a-4f7b-bfe9-2caff893fc7a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:20.447017 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6f21575-2f2a-4f7b-bfe9-2caff893fc7a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:20.447449 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6f21575-2f2a-4f7b-bfe9-2caff893fc7a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:20.580529 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6764e89b-1128-4c61-b854-4ab977415912 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:20.582717 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c6f21575-2f2a-4f7b-bfe9-2caff893fc7a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:20.588510 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6764e89b-1128-4c61-b854-4ab977415912 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.159106 Apr 05 11:21:20.589084 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 499/968] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:20 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:20.590989 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c6f21575-2f2a-4f7b-bfe9-2caff893fc7a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.155406 Apr 05 11:21:20.591550 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 470/969] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:20 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:21.037119 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-1d8162bd-c072-43ec-83a2-0cb97466311a req-de3eefe0-c8a3-42ad-be31-93f66d137a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "078668ec-0695-4717-bef7-1153cdc2dd14", "name": "network-vif-plugged", "status": "completed", "tag": "f631937a-090e-4c88-959c-bbf9308dfac9"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:21.046100 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-1d8162bd-c072-43ec-83a2-0cb97466311a req-de3eefe0-c8a3-42ad-be31-93f66d137a24 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:21.046553 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-1d8162bd-c072-43ec-83a2-0cb97466311a req-de3eefe0-c8a3-42ad-be31-93f66d137a24 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:21.059781 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-1d8162bd-c072-43ec-83a2-0cb97466311a req-de3eefe0-c8a3-42ad-be31-93f66d137a24 service nova] Creating event network-vif-plugged:f631937a-090e-4c88-959c-bbf9308dfac9 for instance 078668ec-0695-4717-bef7-1153cdc2dd14 on hv-cinder-81899 Apr 05 11:21:21.065069 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-1d8162bd-c072-43ec-83a2-0cb97466311a req-de3eefe0-c8a3-42ad-be31-93f66d137a24 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031510 Apr 05 11:21:21.065667 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 500/970] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:21:21.088442 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-aabaab7e-5ce0-4b1b-a04f-feeabed2f847 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:21.090969 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-aabaab7e-5ce0-4b1b-a04f-feeabed2f847 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:21.094918 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aabaab7e-5ce0-4b1b-a04f-feeabed2f847 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:21.095366 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aabaab7e-5ce0-4b1b-a04f-feeabed2f847 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:21.096242 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aabaab7e-5ce0-4b1b-a04f-feeabed2f847 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:21.096675 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aabaab7e-5ce0-4b1b-a04f-feeabed2f847 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:21.231477 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-aabaab7e-5ce0-4b1b-a04f-feeabed2f847 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:21.239095 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-aabaab7e-5ce0-4b1b-a04f-feeabed2f847 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1367 microversion: 2.1 time: 0.154473 Apr 05 11:21:21.239665 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 471/971] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:21 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:21.329579 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-beab31b8-85ad-4219-a454-bf140c5d232e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:21.330259 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-beab31b8-85ad-4219-a454-bf140c5d232e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:21.336332 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-beab31b8-85ad-4219-a454-bf140c5d232e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:21.336777 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-beab31b8-85ad-4219-a454-bf140c5d232e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:21.338035 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-beab31b8-85ad-4219-a454-bf140c5d232e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:21.338465 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-beab31b8-85ad-4219-a454-bf140c5d232e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:21.474053 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-beab31b8-85ad-4219-a454-bf140c5d232e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:21.480382 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-beab31b8-85ad-4219-a454-bf140c5d232e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:21.481814 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-beab31b8-85ad-4219-a454-bf140c5d232e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:21.483279 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-beab31b8-85ad-4219-a454-bf140c5d232e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1406 microversion: 2.20 time: 0.157589 Apr 05 11:21:21.484297 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 501/972] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:21 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:21.607728 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-88d2fe6b-b185-4868-aa22-66a4ef4dc759 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:21.608332 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-88d2fe6b-b185-4868-aa22-66a4ef4dc759 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:21.608792 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b5e33865-1f18-4a5e-a41e-d59839a5d594 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:21.609506 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b5e33865-1f18-4a5e-a41e-d59839a5d594 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:21.614978 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-88d2fe6b-b185-4868-aa22-66a4ef4dc759 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:21.615423 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-88d2fe6b-b185-4868-aa22-66a4ef4dc759 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:21.616208 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-88d2fe6b-b185-4868-aa22-66a4ef4dc759 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:21.616324 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5e33865-1f18-4a5e-a41e-d59839a5d594 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:21.616665 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-88d2fe6b-b185-4868-aa22-66a4ef4dc759 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:21.616871 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5e33865-1f18-4a5e-a41e-d59839a5d594 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:21.617842 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5e33865-1f18-4a5e-a41e-d59839a5d594 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:21.618510 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5e33865-1f18-4a5e-a41e-d59839a5d594 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:21.762072 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b5e33865-1f18-4a5e-a41e-d59839a5d594 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:21.769983 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b5e33865-1f18-4a5e-a41e-d59839a5d594 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.168462 Apr 05 11:21:21.770575 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 472/973] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:21 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:22.010325 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-88d2fe6b-b185-4868-aa22-66a4ef4dc759 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:22.018712 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-88d2fe6b-b185-4868-aa22-66a4ef4dc759 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.414856 Apr 05 11:21:22.019512 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 502/974] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:21 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:22.256213 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-90292929-2f92-4ce1-b652-e2997c36efc6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:22.256816 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-90292929-2f92-4ce1-b652-e2997c36efc6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:22.263279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90292929-2f92-4ce1-b652-e2997c36efc6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:22.263661 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90292929-2f92-4ce1-b652-e2997c36efc6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:22.264435 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90292929-2f92-4ce1-b652-e2997c36efc6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:22.264861 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90292929-2f92-4ce1-b652-e2997c36efc6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:22.404123 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-90292929-2f92-4ce1-b652-e2997c36efc6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:22.411368 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-90292929-2f92-4ce1-b652-e2997c36efc6 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1367 microversion: 2.1 time: 0.159028 Apr 05 11:21:22.411936 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 473/975] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:22 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:22.502357 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-83514c33-1e26-4a94-b460-d8f78f9fff4e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:22.502983 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-83514c33-1e26-4a94-b460-d8f78f9fff4e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:22.509761 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-83514c33-1e26-4a94-b460-d8f78f9fff4e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:22.510203 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-83514c33-1e26-4a94-b460-d8f78f9fff4e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:22.510989 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-83514c33-1e26-4a94-b460-d8f78f9fff4e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:22.511627 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-83514c33-1e26-4a94-b460-d8f78f9fff4e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:22.641598 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-83514c33-1e26-4a94-b460-d8f78f9fff4e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:22.649300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-83514c33-1e26-4a94-b460-d8f78f9fff4e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:22.651438 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-83514c33-1e26-4a94-b460-d8f78f9fff4e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:22.652527 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-83514c33-1e26-4a94-b460-d8f78f9fff4e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1406 microversion: 2.20 time: 0.154176 Apr 05 11:21:22.653094 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 503/976] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:22 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:22.787068 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2aeafaf2-8745-4719-9b9a-186f63eadc1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:22.787676 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2aeafaf2-8745-4719-9b9a-186f63eadc1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:22.793423 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2aeafaf2-8745-4719-9b9a-186f63eadc1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:22.793872 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2aeafaf2-8745-4719-9b9a-186f63eadc1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:22.794654 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2aeafaf2-8745-4719-9b9a-186f63eadc1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:22.795089 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2aeafaf2-8745-4719-9b9a-186f63eadc1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:22.932041 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2aeafaf2-8745-4719-9b9a-186f63eadc1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:22.939306 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2aeafaf2-8745-4719-9b9a-186f63eadc1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.156060 Apr 05 11:21:22.939875 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 474/977] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:22 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:23.036394 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2625c484-28c7-425b-ba14-ff53ca23cbbe tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:23.037009 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2625c484-28c7-425b-ba14-ff53ca23cbbe tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:23.043958 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2625c484-28c7-425b-ba14-ff53ca23cbbe tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:23.044417 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2625c484-28c7-425b-ba14-ff53ca23cbbe tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:23.045197 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2625c484-28c7-425b-ba14-ff53ca23cbbe tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:23.045639 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2625c484-28c7-425b-ba14-ff53ca23cbbe tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:23.082654 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-5caed8d1-734c-4473-a7f8-de28e2f4582a req-c857264b-57bc-4fda-8772-d1f460c573d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af2a30d-f115-44a9-9a90-d1699560bd75", "name": "network-vif-plugged", "status": "completed", "tag": "636d7202-7eb2-4976-9af9-7eb3c2e5f3e2"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:23.091735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-5caed8d1-734c-4473-a7f8-de28e2f4582a req-c857264b-57bc-4fda-8772-d1f460c573d2 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:23.092268 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-5caed8d1-734c-4473-a7f8-de28e2f4582a req-c857264b-57bc-4fda-8772-d1f460c573d2 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:23.104415 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-5caed8d1-734c-4473-a7f8-de28e2f4582a req-c857264b-57bc-4fda-8772-d1f460c573d2 service nova] Creating event network-vif-plugged:636d7202-7eb2-4976-9af9-7eb3c2e5f3e2 for instance 1af2a30d-f115-44a9-9a90-d1699560bd75 on hv-cinder-81899 Apr 05 11:21:23.111038 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-5caed8d1-734c-4473-a7f8-de28e2f4582a req-c857264b-57bc-4fda-8772-d1f460c573d2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032120 Apr 05 11:21:23.112012 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 475/978] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:21:23.188959 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2625c484-28c7-425b-ba14-ff53ca23cbbe tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:23.198928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2625c484-28c7-425b-ba14-ff53ca23cbbe tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.166442 Apr 05 11:21:23.199741 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 504/979] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:23 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:23.429513 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-be4f7967-a6aa-4d25-8451-18258d924983 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:23.430126 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-be4f7967-a6aa-4d25-8451-18258d924983 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:23.436759 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be4f7967-a6aa-4d25-8451-18258d924983 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:23.437200 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be4f7967-a6aa-4d25-8451-18258d924983 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:23.437956 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be4f7967-a6aa-4d25-8451-18258d924983 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:23.438387 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be4f7967-a6aa-4d25-8451-18258d924983 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:23.575079 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-be4f7967-a6aa-4d25-8451-18258d924983 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:23.582372 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-be4f7967-a6aa-4d25-8451-18258d924983 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1367 microversion: 2.1 time: 0.157574 Apr 05 11:21:23.582971 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 476/980] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:23 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:23.670456 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-13ab0262-084c-4240-b00b-5500322673e1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:23.671105 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-13ab0262-084c-4240-b00b-5500322673e1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:23.677847 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13ab0262-084c-4240-b00b-5500322673e1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:23.678293 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13ab0262-084c-4240-b00b-5500322673e1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:23.679092 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13ab0262-084c-4240-b00b-5500322673e1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:23.679584 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13ab0262-084c-4240-b00b-5500322673e1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:23.817711 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-13ab0262-084c-4240-b00b-5500322673e1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:23.825573 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-13ab0262-084c-4240-b00b-5500322673e1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:23.827121 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-13ab0262-084c-4240-b00b-5500322673e1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:23.828292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-13ab0262-084c-4240-b00b-5500322673e1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1406 microversion: 2.20 time: 0.161952 Apr 05 11:21:23.828851 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 505/981] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:23 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:23.958992 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1cc3d04c-e569-4f31-867f-4ffd45e479f7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:23.959646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1cc3d04c-e569-4f31-867f-4ffd45e479f7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:23.968703 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1cc3d04c-e569-4f31-867f-4ffd45e479f7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:23.969199 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1cc3d04c-e569-4f31-867f-4ffd45e479f7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:23.969996 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1cc3d04c-e569-4f31-867f-4ffd45e479f7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:23.970438 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1cc3d04c-e569-4f31-867f-4ffd45e479f7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:24.138928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1cc3d04c-e569-4f31-867f-4ffd45e479f7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:24.146507 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1cc3d04c-e569-4f31-867f-4ffd45e479f7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.193686 Apr 05 11:21:24.147101 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 477/982] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:23 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:24.215610 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-09df214b-39fa-44ea-aa9a-c4f0c706a100 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:24.216143 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-09df214b-39fa-44ea-aa9a-c4f0c706a100 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:24.221979 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09df214b-39fa-44ea-aa9a-c4f0c706a100 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:24.222425 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09df214b-39fa-44ea-aa9a-c4f0c706a100 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:24.223211 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09df214b-39fa-44ea-aa9a-c4f0c706a100 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:24.223642 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09df214b-39fa-44ea-aa9a-c4f0c706a100 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:24.354511 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-09df214b-39fa-44ea-aa9a-c4f0c706a100 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:24.363379 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-09df214b-39fa-44ea-aa9a-c4f0c706a100 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.151405 Apr 05 11:21:24.363944 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 506/983] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:24 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:24.598933 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-946ac7e7-cb34-46cc-829e-ec6b50741c21 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:24.599539 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-946ac7e7-cb34-46cc-829e-ec6b50741c21 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:24.606257 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-946ac7e7-cb34-46cc-829e-ec6b50741c21 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:24.606735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-946ac7e7-cb34-46cc-829e-ec6b50741c21 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:24.607497 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-946ac7e7-cb34-46cc-829e-ec6b50741c21 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:24.607928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-946ac7e7-cb34-46cc-829e-ec6b50741c21 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:24.739057 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-946ac7e7-cb34-46cc-829e-ec6b50741c21 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:24.747169 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-946ac7e7-cb34-46cc-829e-ec6b50741c21 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1367 microversion: 2.1 time: 0.152096 Apr 05 11:21:24.748051 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 478/984] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:24 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:24.846332 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-aaaf9019-b83c-4a85-8af9-745ef7adafae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:24.851316 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-aaaf9019-b83c-4a85-8af9-745ef7adafae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:24.853763 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aaaf9019-b83c-4a85-8af9-745ef7adafae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:24.854213 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aaaf9019-b83c-4a85-8af9-745ef7adafae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:24.855007 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aaaf9019-b83c-4a85-8af9-745ef7adafae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:24.855447 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aaaf9019-b83c-4a85-8af9-745ef7adafae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:24.994353 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-aaaf9019-b83c-4a85-8af9-745ef7adafae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:25.003375 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-aaaf9019-b83c-4a85-8af9-745ef7adafae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:25.004864 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-aaaf9019-b83c-4a85-8af9-745ef7adafae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:25.005968 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-aaaf9019-b83c-4a85-8af9-745ef7adafae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1406 microversion: 2.20 time: 0.163629 Apr 05 11:21:25.006530 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 507/985] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:24 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:25.126953 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-bb63c30f-b349-4638-80d9-4684e99ae9ef req-5ec7f8e9-d51b-4ec6-8620-53bdacb32f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb84f3b-18ce-4112-96a8-e6c729c759d2", "name": "network-vif-plugged", "status": "completed", "tag": "ff329987-a622-46de-9587-bacbc941bd71"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:25.134755 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-bb63c30f-b349-4638-80d9-4684e99ae9ef req-5ec7f8e9-d51b-4ec6-8620-53bdacb32f1d service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:25.135200 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-bb63c30f-b349-4638-80d9-4684e99ae9ef req-5ec7f8e9-d51b-4ec6-8620-53bdacb32f1d service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:25.145522 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-bb63c30f-b349-4638-80d9-4684e99ae9ef req-5ec7f8e9-d51b-4ec6-8620-53bdacb32f1d service nova] Creating event network-vif-plugged:ff329987-a622-46de-9587-bacbc941bd71 for instance 1eb84f3b-18ce-4112-96a8-e6c729c759d2 on hv-cinder-81899 Apr 05 11:21:25.151025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-bb63c30f-b349-4638-80d9-4684e99ae9ef req-5ec7f8e9-d51b-4ec6-8620-53bdacb32f1d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027627 Apr 05 11:21:25.151613 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 479/986] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:21:25.163455 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4c1650a7-ce89-4e21-9887-cefdc414a825 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:25.164065 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4c1650a7-ce89-4e21-9887-cefdc414a825 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:25.170590 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c1650a7-ce89-4e21-9887-cefdc414a825 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:25.171067 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c1650a7-ce89-4e21-9887-cefdc414a825 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:25.171833 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c1650a7-ce89-4e21-9887-cefdc414a825 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:25.172269 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c1650a7-ce89-4e21-9887-cefdc414a825 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:25.311531 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4c1650a7-ce89-4e21-9887-cefdc414a825 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:25.319039 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4c1650a7-ce89-4e21-9887-cefdc414a825 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.159356 Apr 05 11:21:25.319571 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 508/987] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:25 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:25.381779 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a544d75f-5b0c-4f6a-9f1c-9e66d2640472 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:25.382482 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a544d75f-5b0c-4f6a-9f1c-9e66d2640472 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:25.389163 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a544d75f-5b0c-4f6a-9f1c-9e66d2640472 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:25.389614 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a544d75f-5b0c-4f6a-9f1c-9e66d2640472 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:25.390386 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a544d75f-5b0c-4f6a-9f1c-9e66d2640472 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:25.390853 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a544d75f-5b0c-4f6a-9f1c-9e66d2640472 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:25.525649 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a544d75f-5b0c-4f6a-9f1c-9e66d2640472 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:25.536635 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a544d75f-5b0c-4f6a-9f1c-9e66d2640472 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.158788 Apr 05 11:21:25.537588 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 480/988] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:25 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:25.765041 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-43453345-5305-41f4-b920-a80595cf634d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:25.765644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-43453345-5305-41f4-b920-a80595cf634d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:25.771582 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43453345-5305-41f4-b920-a80595cf634d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:25.772025 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43453345-5305-41f4-b920-a80595cf634d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:25.772826 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43453345-5305-41f4-b920-a80595cf634d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:25.773208 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43453345-5305-41f4-b920-a80595cf634d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:25.903950 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-43453345-5305-41f4-b920-a80595cf634d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:25.911164 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-43453345-5305-41f4-b920-a80595cf634d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1367 microversion: 2.1 time: 0.150039 Apr 05 11:21:25.911735 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 509/989] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:25 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:26.024278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-75f5f80e-22a4-4a10-b457-de3ff73fd738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:26.025287 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-75f5f80e-22a4-4a10-b457-de3ff73fd738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:26.031651 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75f5f80e-22a4-4a10-b457-de3ff73fd738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:26.032100 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75f5f80e-22a4-4a10-b457-de3ff73fd738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:26.032868 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75f5f80e-22a4-4a10-b457-de3ff73fd738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:26.033300 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75f5f80e-22a4-4a10-b457-de3ff73fd738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:26.166038 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-75f5f80e-22a4-4a10-b457-de3ff73fd738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:26.173644 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-75f5f80e-22a4-4a10-b457-de3ff73fd738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:26.175203 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-75f5f80e-22a4-4a10-b457-de3ff73fd738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:26.176276 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-75f5f80e-22a4-4a10-b457-de3ff73fd738 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1406 microversion: 2.20 time: 0.156162 Apr 05 11:21:26.176823 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 481/990] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:26 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:21:26.336500 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-486dbe81-f067-49e1-8fb4-e370c483d85b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:26.339503 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-486dbe81-f067-49e1-8fb4-e370c483d85b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:26.345515 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-486dbe81-f067-49e1-8fb4-e370c483d85b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:26.345957 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-486dbe81-f067-49e1-8fb4-e370c483d85b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:26.346751 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-486dbe81-f067-49e1-8fb4-e370c483d85b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:26.347183 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-486dbe81-f067-49e1-8fb4-e370c483d85b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:26.483211 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-486dbe81-f067-49e1-8fb4-e370c483d85b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:26.490719 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-486dbe81-f067-49e1-8fb4-e370c483d85b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.157987 Apr 05 11:21:26.491334 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 510/991] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:26 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:26.558353 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-52bd3052-7513-4b68-bb59-dc5cdd65220e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:26.558944 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-52bd3052-7513-4b68-bb59-dc5cdd65220e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:26.564883 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-52bd3052-7513-4b68-bb59-dc5cdd65220e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:26.565335 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-52bd3052-7513-4b68-bb59-dc5cdd65220e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:26.566104 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-52bd3052-7513-4b68-bb59-dc5cdd65220e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:26.566539 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-52bd3052-7513-4b68-bb59-dc5cdd65220e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:26.701075 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-52bd3052-7513-4b68-bb59-dc5cdd65220e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:26.709141 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-52bd3052-7513-4b68-bb59-dc5cdd65220e tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1734 microversion: 2.1 time: 0.155333 Apr 05 11:21:26.709709 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 482/992] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:26 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:26.929086 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1bd4e791-b6a9-49f7-b561-26a0cee93487 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:26.929665 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1bd4e791-b6a9-49f7-b561-26a0cee93487 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:26.936806 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1bd4e791-b6a9-49f7-b561-26a0cee93487 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:26.937257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1bd4e791-b6a9-49f7-b561-26a0cee93487 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:26.938062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1bd4e791-b6a9-49f7-b561-26a0cee93487 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:26.938502 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1bd4e791-b6a9-49f7-b561-26a0cee93487 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:27.087306 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1bd4e791-b6a9-49f7-b561-26a0cee93487 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:27.094867 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1bd4e791-b6a9-49f7-b561-26a0cee93487 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1367 microversion: 2.1 time: 0.169684 Apr 05 11:21:27.095431 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 511/993] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:26 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:27.193844 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ca3918fd-7a44-4136-9ecb-f4e2ceb4100e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:27.194450 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ca3918fd-7a44-4136-9ecb-f4e2ceb4100e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:27.200929 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca3918fd-7a44-4136-9ecb-f4e2ceb4100e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:27.201421 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca3918fd-7a44-4136-9ecb-f4e2ceb4100e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:27.202210 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca3918fd-7a44-4136-9ecb-f4e2ceb4100e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:27.202650 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca3918fd-7a44-4136-9ecb-f4e2ceb4100e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:27.336215 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ca3918fd-7a44-4136-9ecb-f4e2ceb4100e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:27.344955 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ca3918fd-7a44-4136-9ecb-f4e2ceb4100e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:27.346457 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ca3918fd-7a44-4136-9ecb-f4e2ceb4100e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:27.347643 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ca3918fd-7a44-4136-9ecb-f4e2ceb4100e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1598 microversion: 2.20 time: 0.157715 Apr 05 11:21:27.348241 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 483/994] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:21:27 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:21:27.366229 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c66eb3e2-bd0e-43ea-8122-62dc61072511 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:27.366752 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c66eb3e2-bd0e-43ea-8122-62dc61072511 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:27.372595 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c66eb3e2-bd0e-43ea-8122-62dc61072511 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:27.373042 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c66eb3e2-bd0e-43ea-8122-62dc61072511 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:27.374090 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c66eb3e2-bd0e-43ea-8122-62dc61072511 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:27.374525 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c66eb3e2-bd0e-43ea-8122-62dc61072511 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:27.454917 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c66eb3e2-bd0e-43ea-8122-62dc61072511 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093030 Apr 05 11:21:27.455521 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 512/995] 10.222.0.39 () {60 vars in 1315 bytes} [Tue Apr 5 11:21:27 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:21:27.507417 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-64a987c2-7605-47f4-8591-7fe49a40afce tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:27.508025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-64a987c2-7605-47f4-8591-7fe49a40afce tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:27.513949 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-64a987c2-7605-47f4-8591-7fe49a40afce tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:27.514393 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-64a987c2-7605-47f4-8591-7fe49a40afce tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:27.515200 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-64a987c2-7605-47f4-8591-7fe49a40afce tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:27.515666 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-64a987c2-7605-47f4-8591-7fe49a40afce tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:27.658860 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-64a987c2-7605-47f4-8591-7fe49a40afce tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:27.683733 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-64a987c2-7605-47f4-8591-7fe49a40afce tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1264 microversion: 2.1 time: 0.163277 Apr 05 11:21:27.683733 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 484/996] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:27 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:27.727799 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bd87f837-e682-4e07-81ea-b4a2686f1863 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:27.728517 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bd87f837-e682-4e07-81ea-b4a2686f1863 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:27.734567 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd87f837-e682-4e07-81ea-b4a2686f1863 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:27.735244 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd87f837-e682-4e07-81ea-b4a2686f1863 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:27.736079 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd87f837-e682-4e07-81ea-b4a2686f1863 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:27.736589 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd87f837-e682-4e07-81ea-b4a2686f1863 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:27.997876 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bd87f837-e682-4e07-81ea-b4a2686f1863 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:28.005830 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bd87f837-e682-4e07-81ea-b4a2686f1863 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1714 microversion: 2.1 time: 0.282924 Apr 05 11:21:28.006398 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 513/997] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:27 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1714 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:28.060018 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-432d4907-3dae-435a-9ffa-3aebf61bfc7c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:28.060523 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-432d4907-3dae-435a-9ffa-3aebf61bfc7c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:28.066574 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-432d4907-3dae-435a-9ffa-3aebf61bfc7c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:28.067091 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-432d4907-3dae-435a-9ffa-3aebf61bfc7c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:28.067900 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-432d4907-3dae-435a-9ffa-3aebf61bfc7c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:28.068342 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-432d4907-3dae-435a-9ffa-3aebf61bfc7c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:28.112008 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dd50662a-2769-443a-bcbe-2f6996fe11d2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:28.113517 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dd50662a-2769-443a-bcbe-2f6996fe11d2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:28.120296 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dd50662a-2769-443a-bcbe-2f6996fe11d2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:28.120744 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dd50662a-2769-443a-bcbe-2f6996fe11d2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:28.121589 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dd50662a-2769-443a-bcbe-2f6996fe11d2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:28.121962 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dd50662a-2769-443a-bcbe-2f6996fe11d2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:28.154757 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-432d4907-3dae-435a-9ffa-3aebf61bfc7c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] HTTP exception thrown: Cannot 'detach_volume' instance 0d7680ed-da15-498a-a57d-a37e492ada5b while it is in vm_state rescued Apr 05 11:21:28.155377 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-432d4907-3dae-435a-9ffa-3aebf61bfc7c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Returning 409 to user: Cannot 'detach_volume' instance 0d7680ed-da15-498a-a57d-a37e492ada5b while it is in vm_state rescued {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:21:28.156209 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-432d4907-3dae-435a-9ffa-3aebf61bfc7c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-volume_attachments/4b3c2cbb-29d0-4c7e-aab7-13095307ff04" status: 409 len: 152 microversion: 2.1 time: 0.100855 Apr 05 11:21:28.156772 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 485/998] 10.222.0.39 () {58 vars in 1415 bytes} [Tue Apr 5 11:21:28 2022] DELETE /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-volume_attachments/4b3c2cbb-29d0-4c7e-aab7-13095307ff04 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 05 11:21:28.164797 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-df8409bd-9954-4cc7-9d3e-b5490c50fc1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:28.165372 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-df8409bd-9954-4cc7-9d3e-b5490c50fc1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:28.171097 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df8409bd-9954-4cc7-9d3e-b5490c50fc1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:28.171547 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df8409bd-9954-4cc7-9d3e-b5490c50fc1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:28.172322 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df8409bd-9954-4cc7-9d3e-b5490c50fc1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:28.172758 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df8409bd-9954-4cc7-9d3e-b5490c50fc1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:28.387876 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-dd50662a-2769-443a-bcbe-2f6996fe11d2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:28.395196 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dd50662a-2769-443a-bcbe-2f6996fe11d2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1367 microversion: 2.1 time: 0.287346 Apr 05 11:21:28.395769 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 514/999] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:28 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:28.441653 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-df8409bd-9954-4cc7-9d3e-b5490c50fc1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "POST /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/action" status: 202 len: 0 microversion: 2.1 time: 0.280314 Apr 05 11:21:28.445020 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 486/1000] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:21:28 2022] POST /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:21:28.450548 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5c3ed1ba-7d75-4bf0-87f7-9488bede13df tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:28.451344 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5c3ed1ba-7d75-4bf0-87f7-9488bede13df tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:28.457191 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c3ed1ba-7d75-4bf0-87f7-9488bede13df tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:28.457652 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c3ed1ba-7d75-4bf0-87f7-9488bede13df tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:28.458428 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c3ed1ba-7d75-4bf0-87f7-9488bede13df tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:28.458903 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c3ed1ba-7d75-4bf0-87f7-9488bede13df tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:28.684401 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d84cf2bf-12dd-45a3-99c4-3970bff1e3d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:28.685103 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d84cf2bf-12dd-45a3-99c4-3970bff1e3d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:28.691420 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d84cf2bf-12dd-45a3-99c4-3970bff1e3d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:28.691877 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d84cf2bf-12dd-45a3-99c4-3970bff1e3d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:28.692677 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d84cf2bf-12dd-45a3-99c4-3970bff1e3d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:28.693117 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d84cf2bf-12dd-45a3-99c4-3970bff1e3d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:28.718134 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5c3ed1ba-7d75-4bf0-87f7-9488bede13df tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:28.739535 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5c3ed1ba-7d75-4bf0-87f7-9488bede13df tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1722 microversion: 2.1 time: 0.292757 Apr 05 11:21:28.740551 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 515/1001] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:28 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:28.800479 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-c3d01473-9c06-4495-84ca-369066ae3f0a req-8ea0d595-c7bc-4aa1-82fe-eb3e30763daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "078668ec-0695-4717-bef7-1153cdc2dd14", "tag": "f631937a-090e-4c88-959c-bbf9308dfac9"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:28.808923 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c3d01473-9c06-4495-84ca-369066ae3f0a req-8ea0d595-c7bc-4aa1-82fe-eb3e30763daf service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:28.809370 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c3d01473-9c06-4495-84ca-369066ae3f0a req-8ea0d595-c7bc-4aa1-82fe-eb3e30763daf service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:28.820724 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-c3d01473-9c06-4495-84ca-369066ae3f0a req-8ea0d595-c7bc-4aa1-82fe-eb3e30763daf service nova] Creating event network-changed:f631937a-090e-4c88-959c-bbf9308dfac9 for instance 078668ec-0695-4717-bef7-1153cdc2dd14 on hv-cinder-81899 Apr 05 11:21:28.826652 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-c3d01473-9c06-4495-84ca-369066ae3f0a req-8ea0d595-c7bc-4aa1-82fe-eb3e30763daf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031707 Apr 05 11:21:28.827182 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 516/1002] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:21:28.852235 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d84cf2bf-12dd-45a3-99c4-3970bff1e3d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:28.860929 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d84cf2bf-12dd-45a3-99c4-3970bff1e3d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1452 microversion: 2.1 time: 0.181619 Apr 05 11:21:28.861599 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 487/1003] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:28 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:28.878138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e26c07d3-2e61-4c3b-a016-d43555eea445 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:28.879822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e26c07d3-2e61-4c3b-a016-d43555eea445 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:28.887087 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e26c07d3-2e61-4c3b-a016-d43555eea445 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:28.887634 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e26c07d3-2e61-4c3b-a016-d43555eea445 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:28.888781 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e26c07d3-2e61-4c3b-a016-d43555eea445 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:28.889043 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e26c07d3-2e61-4c3b-a016-d43555eea445 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:29.056617 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e26c07d3-2e61-4c3b-a016-d43555eea445 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:29.064184 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e26c07d3-2e61-4c3b-a016-d43555eea445 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1452 microversion: 2.1 time: 0.190554 Apr 05 11:21:29.064758 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 517/1004] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:28 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1452 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:29.411948 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cffbb63b-46c4-4b87-891a-93a5aa5ad37d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:29.412574 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cffbb63b-46c4-4b87-891a-93a5aa5ad37d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:29.422586 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cffbb63b-46c4-4b87-891a-93a5aa5ad37d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:29.443262 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cffbb63b-46c4-4b87-891a-93a5aa5ad37d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:29.443262 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cffbb63b-46c4-4b87-891a-93a5aa5ad37d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:29.443262 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cffbb63b-46c4-4b87-891a-93a5aa5ad37d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:29.688517 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cffbb63b-46c4-4b87-891a-93a5aa5ad37d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:29.698038 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cffbb63b-46c4-4b87-891a-93a5aa5ad37d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1367 microversion: 2.1 time: 0.289852 Apr 05 11:21:29.698718 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 488/1005] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:29 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:29.757430 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a84fb51a-e154-41f4-b3f4-abd5b8ab4976 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:29.758047 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a84fb51a-e154-41f4-b3f4-abd5b8ab4976 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:29.764691 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a84fb51a-e154-41f4-b3f4-abd5b8ab4976 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:29.765157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a84fb51a-e154-41f4-b3f4-abd5b8ab4976 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:29.765924 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a84fb51a-e154-41f4-b3f4-abd5b8ab4976 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:29.766357 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a84fb51a-e154-41f4-b3f4-abd5b8ab4976 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:30.025374 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a84fb51a-e154-41f4-b3f4-abd5b8ab4976 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:30.033612 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a84fb51a-e154-41f4-b3f4-abd5b8ab4976 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1722 microversion: 2.1 time: 0.280084 Apr 05 11:21:30.034318 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 518/1006] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:29 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:30.715492 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-89b707bd-e8de-4754-9ff2-a06fe872e494 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:30.716110 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-89b707bd-e8de-4754-9ff2-a06fe872e494 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:30.722533 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89b707bd-e8de-4754-9ff2-a06fe872e494 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:30.723047 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89b707bd-e8de-4754-9ff2-a06fe872e494 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:30.723853 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89b707bd-e8de-4754-9ff2-a06fe872e494 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:30.724296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89b707bd-e8de-4754-9ff2-a06fe872e494 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:30.860566 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-89b707bd-e8de-4754-9ff2-a06fe872e494 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:30.868245 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-89b707bd-e8de-4754-9ff2-a06fe872e494 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1557 microversion: 2.1 time: 0.157381 Apr 05 11:21:30.868825 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 489/1007] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:30 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:30.885109 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-86939075-74f0-49f0-8bd5-17704f7ee374 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:30.885626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-86939075-74f0-49f0-8bd5-17704f7ee374 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:30.891501 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86939075-74f0-49f0-8bd5-17704f7ee374 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:30.891990 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86939075-74f0-49f0-8bd5-17704f7ee374 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:30.892731 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86939075-74f0-49f0-8bd5-17704f7ee374 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:30.893171 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86939075-74f0-49f0-8bd5-17704f7ee374 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:31.052524 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a865551d-74a5-472a-8bf6-f725368798e3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:31.053141 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a865551d-74a5-472a-8bf6-f725368798e3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:31.059758 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a865551d-74a5-472a-8bf6-f725368798e3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:31.060218 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a865551d-74a5-472a-8bf6-f725368798e3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:31.060999 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a865551d-74a5-472a-8bf6-f725368798e3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:31.061444 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a865551d-74a5-472a-8bf6-f725368798e3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:31.281940 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-86939075-74f0-49f0-8bd5-17704f7ee374 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.401244 Apr 05 11:21:31.282533 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 519/1008] 10.222.0.39 () {58 vars in 1274 bytes} [Tue Apr 5 11:21:30 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-interface => generated 284 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:21:31.323073 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a865551d-74a5-472a-8bf6-f725368798e3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:31.332962 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a865551d-74a5-472a-8bf6-f725368798e3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1722 microversion: 2.1 time: 0.284257 Apr 05 11:21:31.333780 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 490/1009] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:31 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:32.024688 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-fbc88c49-b7bd-4f5f-a107-719137b7d8e7 req-0444825e-6252-4ae7-8d00-b0a9df83eba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af2a30d-f115-44a9-9a90-d1699560bd75", "tag": "636d7202-7eb2-4976-9af9-7eb3c2e5f3e2"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:32.033474 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-fbc88c49-b7bd-4f5f-a107-719137b7d8e7 req-0444825e-6252-4ae7-8d00-b0a9df83eba2 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:32.034209 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-fbc88c49-b7bd-4f5f-a107-719137b7d8e7 req-0444825e-6252-4ae7-8d00-b0a9df83eba2 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:32.046021 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-fbc88c49-b7bd-4f5f-a107-719137b7d8e7 req-0444825e-6252-4ae7-8d00-b0a9df83eba2 service nova] Creating event network-changed:636d7202-7eb2-4976-9af9-7eb3c2e5f3e2 for instance 1af2a30d-f115-44a9-9a90-d1699560bd75 on hv-cinder-81899 Apr 05 11:21:32.051046 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-fbc88c49-b7bd-4f5f-a107-719137b7d8e7 req-0444825e-6252-4ae7-8d00-b0a9df83eba2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030609 Apr 05 11:21:32.051716 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 520/1010] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:21:32.355334 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0d572bc2-1b9d-4a67-b5a8-8e89154a5a53 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:32.355941 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0d572bc2-1b9d-4a67-b5a8-8e89154a5a53 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:32.363378 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0d572bc2-1b9d-4a67-b5a8-8e89154a5a53 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:32.363828 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0d572bc2-1b9d-4a67-b5a8-8e89154a5a53 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:32.364725 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0d572bc2-1b9d-4a67-b5a8-8e89154a5a53 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:32.365241 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0d572bc2-1b9d-4a67-b5a8-8e89154a5a53 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:32.512464 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0d572bc2-1b9d-4a67-b5a8-8e89154a5a53 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:32.524842 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0d572bc2-1b9d-4a67-b5a8-8e89154a5a53 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1722 microversion: 2.1 time: 0.170772 Apr 05 11:21:32.524842 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 491/1011] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:32 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:33.540933 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-43834cc1-141d-4b7f-9dd3-d84eb115cf73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:33.541619 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-43834cc1-141d-4b7f-9dd3-d84eb115cf73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:33.548114 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43834cc1-141d-4b7f-9dd3-d84eb115cf73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:33.548509 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43834cc1-141d-4b7f-9dd3-d84eb115cf73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:33.549274 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43834cc1-141d-4b7f-9dd3-d84eb115cf73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:33.550161 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43834cc1-141d-4b7f-9dd3-d84eb115cf73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:33.683109 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-43834cc1-141d-4b7f-9dd3-d84eb115cf73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:33.693728 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-43834cc1-141d-4b7f-9dd3-d84eb115cf73 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1722 microversion: 2.1 time: 0.157718 Apr 05 11:21:33.694676 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 521/1012] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:33 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:34.065641 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-5d86cbb6-d829-4a66-b96d-c94c5c63dfb8 req-7341942c-53f6-4b8f-95b3-e1064e8ba880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb84f3b-18ce-4112-96a8-e6c729c759d2", "tag": "ff329987-a622-46de-9587-bacbc941bd71"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:34.073985 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-5d86cbb6-d829-4a66-b96d-c94c5c63dfb8 req-7341942c-53f6-4b8f-95b3-e1064e8ba880 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:34.074510 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-5d86cbb6-d829-4a66-b96d-c94c5c63dfb8 req-7341942c-53f6-4b8f-95b3-e1064e8ba880 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:34.085307 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-5d86cbb6-d829-4a66-b96d-c94c5c63dfb8 req-7341942c-53f6-4b8f-95b3-e1064e8ba880 service nova] Creating event network-changed:ff329987-a622-46de-9587-bacbc941bd71 for instance 1eb84f3b-18ce-4112-96a8-e6c729c759d2 on hv-cinder-81899 Apr 05 11:21:34.090686 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-5d86cbb6-d829-4a66-b96d-c94c5c63dfb8 req-7341942c-53f6-4b8f-95b3-e1064e8ba880 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028705 Apr 05 11:21:34.091278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 492/1013] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:21:34.325843 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0ef1273e-dc8c-433c-baef-377d6209266e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:34.326820 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0ef1273e-dc8c-433c-baef-377d6209266e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:34.332795 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ef1273e-dc8c-433c-baef-377d6209266e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:34.333239 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ef1273e-dc8c-433c-baef-377d6209266e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:34.334038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ef1273e-dc8c-433c-baef-377d6209266e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:34.334466 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ef1273e-dc8c-433c-baef-377d6209266e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:34.362071 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0ef1273e-dc8c-433c-baef-377d6209266e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040980 Apr 05 11:21:34.362664 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 522/1014] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:21:34 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 05 11:21:34.418796 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cc924912-8c50-47fb-99ce-91af772e6401 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:34.419377 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cc924912-8c50-47fb-99ce-91af772e6401 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:34.425363 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cc924912-8c50-47fb-99ce-91af772e6401 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:34.425814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cc924912-8c50-47fb-99ce-91af772e6401 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:34.426581 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cc924912-8c50-47fb-99ce-91af772e6401 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:34.427048 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cc924912-8c50-47fb-99ce-91af772e6401 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:34.450801 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cc924912-8c50-47fb-99ce-91af772e6401 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:21:34.711470 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b825c402-d613-49ce-a43c-eb6590e47645 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:34.712110 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b825c402-d613-49ce-a43c-eb6590e47645 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:34.718413 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b825c402-d613-49ce-a43c-eb6590e47645 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:34.718903 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b825c402-d613-49ce-a43c-eb6590e47645 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:34.719729 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b825c402-d613-49ce-a43c-eb6590e47645 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:34.720165 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b825c402-d613-49ce-a43c-eb6590e47645 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:34.856018 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b825c402-d613-49ce-a43c-eb6590e47645 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:34.864241 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b825c402-d613-49ce-a43c-eb6590e47645 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1722 microversion: 2.1 time: 0.156694 Apr 05 11:21:34.864801 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 523/1015] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:34 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:34.883734 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cc924912-8c50-47fb-99ce-91af772e6401 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 204 len: 0 microversion: 2.1 time: 0.468814 Apr 05 11:21:34.884408 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 493/1016] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:21:34 2022] DELETE /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:21:34.892694 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-257abbe6-02fe-4918-8368-fb5c30608e4d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:34.893305 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-257abbe6-02fe-4918-8368-fb5c30608e4d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:34.899203 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-257abbe6-02fe-4918-8368-fb5c30608e4d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:34.899650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-257abbe6-02fe-4918-8368-fb5c30608e4d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:34.900423 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-257abbe6-02fe-4918-8368-fb5c30608e4d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:34.900851 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-257abbe6-02fe-4918-8368-fb5c30608e4d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:35.041505 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-257abbe6-02fe-4918-8368-fb5c30608e4d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:35.050034 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-257abbe6-02fe-4918-8368-fb5c30608e4d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1672 microversion: 2.1 time: 0.160972 Apr 05 11:21:35.050852 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 524/1017] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:34 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:35.882141 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2ef246f2-6297-4b0c-86f0-bb9747f505e9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:35.882875 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2ef246f2-6297-4b0c-86f0-bb9747f505e9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:35.889872 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2ef246f2-6297-4b0c-86f0-bb9747f505e9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:35.890279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2ef246f2-6297-4b0c-86f0-bb9747f505e9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:35.891109 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2ef246f2-6297-4b0c-86f0-bb9747f505e9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:35.891551 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2ef246f2-6297-4b0c-86f0-bb9747f505e9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:36.069138 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dc1cddca-51b3-4fdd-a674-de2f53ffdc05 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:36.069755 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dc1cddca-51b3-4fdd-a674-de2f53ffdc05 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:36.077152 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc1cddca-51b3-4fdd-a674-de2f53ffdc05 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:36.077605 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc1cddca-51b3-4fdd-a674-de2f53ffdc05 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:36.078374 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc1cddca-51b3-4fdd-a674-de2f53ffdc05 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:36.078848 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc1cddca-51b3-4fdd-a674-de2f53ffdc05 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:36.124003 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2ef246f2-6297-4b0c-86f0-bb9747f505e9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:36.132178 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2ef246f2-6297-4b0c-86f0-bb9747f505e9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1728 microversion: 2.1 time: 0.254269 Apr 05 11:21:36.133425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 494/1018] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:35 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1728 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:36.149863 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d46a79f1-ccf7-4dcf-8976-bb8fcd3b7553 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:36.150543 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d46a79f1-ccf7-4dcf-8976-bb8fcd3b7553 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:36.157097 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d46a79f1-ccf7-4dcf-8976-bb8fcd3b7553 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:36.157675 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d46a79f1-ccf7-4dcf-8976-bb8fcd3b7553 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:36.158593 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d46a79f1-ccf7-4dcf-8976-bb8fcd3b7553 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:36.159143 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d46a79f1-ccf7-4dcf-8976-bb8fcd3b7553 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:36.221632 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-dc1cddca-51b3-4fdd-a674-de2f53ffdc05 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:36.230152 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dc1cddca-51b3-4fdd-a674-de2f53ffdc05 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1672 microversion: 2.1 time: 0.164852 Apr 05 11:21:36.230764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 525/1019] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:36 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:36.296767 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d46a79f1-ccf7-4dcf-8976-bb8fcd3b7553 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151275 Apr 05 11:21:36.297598 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 495/1020] 10.222.0.39 () {58 vars in 1274 bytes} [Tue Apr 5 11:21:36 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:21:37.268552 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4f5686d1-274c-41c1-b281-8ae43e83d651 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:37.269172 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4f5686d1-274c-41c1-b281-8ae43e83d651 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:37.276022 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f5686d1-274c-41c1-b281-8ae43e83d651 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:37.276742 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f5686d1-274c-41c1-b281-8ae43e83d651 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:37.277700 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f5686d1-274c-41c1-b281-8ae43e83d651 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:37.278295 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f5686d1-274c-41c1-b281-8ae43e83d651 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:37.382724 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4f5686d1-274c-41c1-b281-8ae43e83d651 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:37.390343 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4f5686d1-274c-41c1-b281-8ae43e83d651 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1604 microversion: 2.1 time: 0.125683 Apr 05 11:21:37.390937 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 526/1021] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:37 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1604 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:37.481769 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-47c18512-7fde-4117-9641-29e735a78ad4 req-53f93bdf-6f32-41c9-ab23-d227c47bc156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98ab2b1-5651-42f4-b1f3-de4469d542ad", "name": "network-vif-deleted", "tag": "dc7aebba-05fe-428c-9500-aeca3f7e1c99"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:37.500041 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-47c18512-7fde-4117-9641-29e735a78ad4 req-53f93bdf-6f32-41c9-ab23-d227c47bc156 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:37.505120 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-47c18512-7fde-4117-9641-29e735a78ad4 req-53f93bdf-6f32-41c9-ab23-d227c47bc156 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:37.520033 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-47c18512-7fde-4117-9641-29e735a78ad4 req-53f93bdf-6f32-41c9-ab23-d227c47bc156 service nova] Creating event network-vif-deleted:dc7aebba-05fe-428c-9500-aeca3f7e1c99 for instance a98ab2b1-5651-42f4-b1f3-de4469d542ad on hv-cinder-81899 Apr 05 11:21:37.531526 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-47c18512-7fde-4117-9641-29e735a78ad4 req-53f93bdf-6f32-41c9-ab23-d227c47bc156 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056033 Apr 05 11:21:37.532791 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 496/1022] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:21:37.601444 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-c344195f-15bd-44ce-aaab-2494babec074 req-2fda3959-c7fb-4069-a012-c7d283e3f35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7680ed-da15-498a-a57d-a37e492ada5b", "tag": "141f21be-2523-4672-a366-4a146e7780e9"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:37.629456 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c344195f-15bd-44ce-aaab-2494babec074 req-2fda3959-c7fb-4069-a012-c7d283e3f35d service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:37.631139 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c344195f-15bd-44ce-aaab-2494babec074 req-2fda3959-c7fb-4069-a012-c7d283e3f35d service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:37.650129 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-c344195f-15bd-44ce-aaab-2494babec074 req-2fda3959-c7fb-4069-a012-c7d283e3f35d service nova] Creating event network-changed:141f21be-2523-4672-a366-4a146e7780e9 for instance 0d7680ed-da15-498a-a57d-a37e492ada5b on hv-cinder-81899 Apr 05 11:21:37.656648 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-c344195f-15bd-44ce-aaab-2494babec074 req-2fda3959-c7fb-4069-a012-c7d283e3f35d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059205 Apr 05 11:21:37.658454 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 527/1023] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:21:38.408225 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-45ed7896-dc7d-4cc8-a490-3d9bfa68906a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:38.409017 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-45ed7896-dc7d-4cc8-a490-3d9bfa68906a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:38.418101 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45ed7896-dc7d-4cc8-a490-3d9bfa68906a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:38.418695 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45ed7896-dc7d-4cc8-a490-3d9bfa68906a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:38.419739 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45ed7896-dc7d-4cc8-a490-3d9bfa68906a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:38.420374 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45ed7896-dc7d-4cc8-a490-3d9bfa68906a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:38.463170 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45ed7896-dc7d-4cc8-a490-3d9bfa68906a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:38.464033 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45ed7896-dc7d-4cc8-a490-3d9bfa68906a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:38.464757 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-45ed7896-dc7d-4cc8-a490-3d9bfa68906a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lazy-loading 'fault' on Instance uuid a98ab2b1-5651-42f4-b1f3-de4469d542ad {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:21:38.541869 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-45ed7896-dc7d-4cc8-a490-3d9bfa68906a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:38.550078 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-45ed7896-dc7d-4cc8-a490-3d9bfa68906a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 200 len: 1326 microversion: 2.1 time: 0.146028 Apr 05 11:21:38.551166 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 497/1024] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:38 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:39.570049 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-da93d1c3-6592-4e5a-95a2-f327bc92572b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:39.570676 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-da93d1c3-6592-4e5a-95a2-f327bc92572b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:39.577599 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-da93d1c3-6592-4e5a-95a2-f327bc92572b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:39.578038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-da93d1c3-6592-4e5a-95a2-f327bc92572b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:39.578827 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-da93d1c3-6592-4e5a-95a2-f327bc92572b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:39.579257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-da93d1c3-6592-4e5a-95a2-f327bc92572b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:39.592860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-da93d1c3-6592-4e5a-95a2-f327bc92572b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] HTTP exception thrown: Instance a98ab2b1-5651-42f4-b1f3-de4469d542ad could not be found. Apr 05 11:21:39.593438 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-da93d1c3-6592-4e5a-95a2-f327bc92572b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Returning 404 to user: Instance a98ab2b1-5651-42f4-b1f3-de4469d542ad could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:21:39.594256 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-da93d1c3-6592-4e5a-95a2-f327bc92572b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 404 len: 111 microversion: 2.1 time: 0.028647 Apr 05 11:21:39.594813 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 528/1025] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:39 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:21:39.603346 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1af6116a-73e6-449f-91ce-5979ba4f05ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '.version_select at 0x7fec0c07f940>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:39.672939 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-2a16d4cb-a473-4ef4-8293-c6c16d6b649b req-16f5a2f2-a961-46d0-8cda-d3478da321e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7680ed-da15-498a-a57d-a37e492ada5b", "tag": "141f21be-2523-4672-a366-4a146e7780e9"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:39.680737 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-2a16d4cb-a473-4ef4-8293-c6c16d6b649b req-16f5a2f2-a961-46d0-8cda-d3478da321e7 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:39.681178 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-2a16d4cb-a473-4ef4-8293-c6c16d6b649b req-16f5a2f2-a961-46d0-8cda-d3478da321e7 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:39.692105 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-2a16d4cb-a473-4ef4-8293-c6c16d6b649b req-16f5a2f2-a961-46d0-8cda-d3478da321e7 service nova] Creating event network-changed:141f21be-2523-4672-a366-4a146e7780e9 for instance 0d7680ed-da15-498a-a57d-a37e492ada5b on hv-cinder-81899 Apr 05 11:21:39.694442 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1af6116a-73e6-449f-91ce-5979ba4f05ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-614454025" status: 202 len: 0 microversion: 2.1 time: 0.095053 Apr 05 11:21:39.698795 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 498/1026] 10.222.0.39 () {58 vars in 1217 bytes} [Tue Apr 5 11:21:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-614454025 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:21:39.698953 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-2a16d4cb-a473-4ef4-8293-c6c16d6b649b req-16f5a2f2-a961-46d0-8cda-d3478da321e7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028282 Apr 05 11:21:39.698953 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 529/1027] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:21:40.872482 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d0542e3a-7c6b-43c5-86d4-2b18522269b3 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Action: 'create', calling method: .version_select at 0x7fec0c1630d0>, body: {"keypair": {"name": "tempest-keypair-653272782"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:40.886636 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-d0542e3a-7c6b-43c5-86d4-2b18522269b3 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Getting quotas for project e6061eea75194ee5b5efeed2e6073d75. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:21:40.890483 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-d0542e3a-7c6b-43c5-86d4-2b18522269b3 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Getting quotas for user b5466bcb6971420bb3a765a38bb008a5 and project e6061eea75194ee5b5efeed2e6073d75. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:21:41.343293 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-d0542e3a-7c6b-43c5-86d4-2b18522269b3 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Getting quotas for project e6061eea75194ee5b5efeed2e6073d75. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:21:41.347191 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-d0542e3a-7c6b-43c5-86d4-2b18522269b3 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Getting quotas for user b5466bcb6971420bb3a765a38bb008a5 and project e6061eea75194ee5b5efeed2e6073d75. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:21:41.361151 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d0542e3a-7c6b-43c5-86d4-2b18522269b3 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.493175 Apr 05 11:21:41.361784 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 499/1028] 10.222.0.39 () {60 vars in 1157 bytes} [Tue Apr 5 11:21:40 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:44.195288 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-336741142", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7217652a-af97-4947-b0e2-d005c4528ce6"}], "security_groups": [{"name": "tempest-securitygroup--1450084525"}], "key_name": "tempest-keypair-653272782", "user_data": "}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:44.297145 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] validate_networks() for [('7217652a-af97-4947-b0e2-d005c4528ce6', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:21:44.666671 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:21:44.667092 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:21:44.667558 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:21:44.667958 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:21:44.668362 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:21:44.676838 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:44.677282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:44.678071 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:44.678499 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:44.694142 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Getting quotas for project e6061eea75194ee5b5efeed2e6073d75. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:21:44.698670 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Getting quotas for user b5466bcb6971420bb3a765a38bb008a5 and project e6061eea75194ee5b5efeed2e6073d75. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:21:44.709801 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:21:44.712630 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:21:44.868325 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6f6f3f8f-5feb-4e41-b2fe-0216b2f8a733 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.678095 Apr 05 11:21:44.868972 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 530/1029] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:21:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:21:44.879092 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8a242966-68a9-484f-be57-dde36e564fed tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:44.880045 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8a242966-68a9-484f-be57-dde36e564fed tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:44.937130 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8a242966-68a9-484f-be57-dde36e564fed tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:44.943859 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8a242966-68a9-484f-be57-dde36e564fed tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1236 microversion: 2.1 time: 0.068744 Apr 05 11:21:44.944513 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 500/1030] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:44 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:45.963729 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-60b69a76-5fa9-4e40-bf7c-36bbb12df1ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:45.968419 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-60b69a76-5fa9-4e40-bf7c-36bbb12df1ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:45.975208 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-60b69a76-5fa9-4e40-bf7c-36bbb12df1ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:45.976097 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-60b69a76-5fa9-4e40-bf7c-36bbb12df1ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:45.976948 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-60b69a76-5fa9-4e40-bf7c-36bbb12df1ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:45.978073 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-60b69a76-5fa9-4e40-bf7c-36bbb12df1ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:46.036912 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-60b69a76-5fa9-4e40-bf7c-36bbb12df1ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:46.045171 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-60b69a76-5fa9-4e40-bf7c-36bbb12df1ec tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1240 microversion: 2.1 time: 0.087847 Apr 05 11:21:46.045728 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 531/1031] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:45 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:47.063289 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1565eb87-5f4b-4fa5-ab89-5bbea62041a2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:47.063829 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1565eb87-5f4b-4fa5-ab89-5bbea62041a2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:47.070046 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1565eb87-5f4b-4fa5-ab89-5bbea62041a2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:47.070491 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1565eb87-5f4b-4fa5-ab89-5bbea62041a2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:47.071280 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1565eb87-5f4b-4fa5-ab89-5bbea62041a2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:47.071715 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1565eb87-5f4b-4fa5-ab89-5bbea62041a2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:47.134063 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1565eb87-5f4b-4fa5-ab89-5bbea62041a2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:47.141703 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1565eb87-5f4b-4fa5-ab89-5bbea62041a2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1288 microversion: 2.1 time: 0.082364 Apr 05 11:21:47.142277 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 501/1032] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:47 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:48.166933 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ac33eeb2-e239-46a9-a17a-b93bce3ff45a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:48.166933 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ac33eeb2-e239-46a9-a17a-b93bce3ff45a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:48.172714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ac33eeb2-e239-46a9-a17a-b93bce3ff45a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:48.173531 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ac33eeb2-e239-46a9-a17a-b93bce3ff45a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:48.174910 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ac33eeb2-e239-46a9-a17a-b93bce3ff45a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:48.175709 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ac33eeb2-e239-46a9-a17a-b93bce3ff45a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:48.249365 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ac33eeb2-e239-46a9-a17a-b93bce3ff45a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:48.256713 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ac33eeb2-e239-46a9-a17a-b93bce3ff45a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1294 microversion: 2.1 time: 0.102285 Apr 05 11:21:48.257276 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 532/1033] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:48 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:49.273429 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-48dde9b1-c337-4616-933b-41e56040cd81 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:49.276356 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-48dde9b1-c337-4616-933b-41e56040cd81 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:49.281051 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-48dde9b1-c337-4616-933b-41e56040cd81 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:49.281506 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-48dde9b1-c337-4616-933b-41e56040cd81 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:49.282322 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-48dde9b1-c337-4616-933b-41e56040cd81 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:49.282790 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-48dde9b1-c337-4616-933b-41e56040cd81 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:49.448240 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-9846abb7-b920-491f-aede-bce2e721efc3 req-195adee4-4d04-45ee-b2a7-fb349ca538ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5ad1a46-8a77-4def-b880-e32ca5f36db1", "tag": "8634b263-44cb-4aa1-94a2-580363a6f345"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:49.457238 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-9846abb7-b920-491f-aede-bce2e721efc3 req-195adee4-4d04-45ee-b2a7-fb349ca538ab service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:49.457681 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-9846abb7-b920-491f-aede-bce2e721efc3 req-195adee4-4d04-45ee-b2a7-fb349ca538ab service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:49.470303 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-9846abb7-b920-491f-aede-bce2e721efc3 req-195adee4-4d04-45ee-b2a7-fb349ca538ab service nova] Creating event network-changed:8634b263-44cb-4aa1-94a2-580363a6f345 for instance f5ad1a46-8a77-4def-b880-e32ca5f36db1 on hv-cinder-81899 Apr 05 11:21:49.477487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-9846abb7-b920-491f-aede-bce2e721efc3 req-195adee4-4d04-45ee-b2a7-fb349ca538ab service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033148 Apr 05 11:21:49.478176 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 533/1034] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:21:49.493431 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-48dde9b1-c337-4616-933b-41e56040cd81 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:49.504709 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-48dde9b1-c337-4616-933b-41e56040cd81 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1362 microversion: 2.1 time: 0.233981 Apr 05 11:21:49.512090 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 502/1035] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:49 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:50.523631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c1923ebe-477f-43c0-9564-c073884e2e73 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:50.524817 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c1923ebe-477f-43c0-9564-c073884e2e73 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:50.531342 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c1923ebe-477f-43c0-9564-c073884e2e73 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:50.532987 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c1923ebe-477f-43c0-9564-c073884e2e73 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:50.532987 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c1923ebe-477f-43c0-9564-c073884e2e73 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:50.533187 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c1923ebe-477f-43c0-9564-c073884e2e73 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:50.664394 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c1923ebe-477f-43c0-9564-c073884e2e73 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:50.672282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c1923ebe-477f-43c0-9564-c073884e2e73 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1362 microversion: 2.1 time: 0.152925 Apr 05 11:21:50.672840 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 534/1036] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:50 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:51.688268 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-af127f4b-aed8-4f2c-a66d-62e06ab272e2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:51.688796 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-af127f4b-aed8-4f2c-a66d-62e06ab272e2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:51.695040 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-af127f4b-aed8-4f2c-a66d-62e06ab272e2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:51.695491 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-af127f4b-aed8-4f2c-a66d-62e06ab272e2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:51.696776 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-af127f4b-aed8-4f2c-a66d-62e06ab272e2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:51.697210 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-af127f4b-aed8-4f2c-a66d-62e06ab272e2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:51.834046 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-af127f4b-aed8-4f2c-a66d-62e06ab272e2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:51.842210 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-af127f4b-aed8-4f2c-a66d-62e06ab272e2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1362 microversion: 2.1 time: 0.157883 Apr 05 11:21:51.842805 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 503/1037] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:51 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:52.860289 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f4834ad2-eefa-4f9b-b37b-a3e5e96d479f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:52.860902 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f4834ad2-eefa-4f9b-b37b-a3e5e96d479f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:52.867707 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f4834ad2-eefa-4f9b-b37b-a3e5e96d479f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:52.868152 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f4834ad2-eefa-4f9b-b37b-a3e5e96d479f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:52.868915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f4834ad2-eefa-4f9b-b37b-a3e5e96d479f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:52.869352 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f4834ad2-eefa-4f9b-b37b-a3e5e96d479f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:53.004269 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f4834ad2-eefa-4f9b-b37b-a3e5e96d479f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:53.011969 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f4834ad2-eefa-4f9b-b37b-a3e5e96d479f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1362 microversion: 2.1 time: 0.156044 Apr 05 11:21:53.012539 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 535/1038] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:52 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:54.028436 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6a33ae01-04fa-47eb-954e-5f77605c3de5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:54.029044 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6a33ae01-04fa-47eb-954e-5f77605c3de5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:54.035081 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6a33ae01-04fa-47eb-954e-5f77605c3de5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:54.035542 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6a33ae01-04fa-47eb-954e-5f77605c3de5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:54.036311 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6a33ae01-04fa-47eb-954e-5f77605c3de5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:54.036753 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6a33ae01-04fa-47eb-954e-5f77605c3de5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:54.165854 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6a33ae01-04fa-47eb-954e-5f77605c3de5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:54.173720 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6a33ae01-04fa-47eb-954e-5f77605c3de5 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1362 microversion: 2.1 time: 0.149693 Apr 05 11:21:54.174286 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 504/1039] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:54 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:55.190260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4810b10b-ff14-4700-b1f4-0b40e05ed41b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:55.190905 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4810b10b-ff14-4700-b1f4-0b40e05ed41b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:55.198580 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4810b10b-ff14-4700-b1f4-0b40e05ed41b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:55.198878 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4810b10b-ff14-4700-b1f4-0b40e05ed41b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:55.199845 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4810b10b-ff14-4700-b1f4-0b40e05ed41b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:55.200289 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4810b10b-ff14-4700-b1f4-0b40e05ed41b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:55.335233 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4810b10b-ff14-4700-b1f4-0b40e05ed41b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:55.342491 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4810b10b-ff14-4700-b1f4-0b40e05ed41b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1362 microversion: 2.1 time: 0.156275 Apr 05 11:21:55.343090 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 536/1040] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:55 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:56.360446 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-85ffc447-78d8-4f45-bc90-f9c14d3b391b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:56.361059 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-85ffc447-78d8-4f45-bc90-f9c14d3b391b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:56.367895 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-85ffc447-78d8-4f45-bc90-f9c14d3b391b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:56.368342 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-85ffc447-78d8-4f45-bc90-f9c14d3b391b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:56.369112 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-85ffc447-78d8-4f45-bc90-f9c14d3b391b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:56.369552 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-85ffc447-78d8-4f45-bc90-f9c14d3b391b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:56.501810 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-85ffc447-78d8-4f45-bc90-f9c14d3b391b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:56.509014 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-85ffc447-78d8-4f45-bc90-f9c14d3b391b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1362 microversion: 2.1 time: 0.152530 Apr 05 11:21:56.509622 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 505/1041] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:56 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:56.937696 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1d881123-f4b9-40df-9760-dc59985326d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:56.938360 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1d881123-f4b9-40df-9760-dc59985326d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:56.944145 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d881123-f4b9-40df-9760-dc59985326d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:56.944595 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d881123-f4b9-40df-9760-dc59985326d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:56.945361 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d881123-f4b9-40df-9760-dc59985326d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:56.945794 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d881123-f4b9-40df-9760-dc59985326d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:56.968239 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-1d881123-f4b9-40df-9760-dc59985326d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lazy-loading 'flavor' on Instance uuid e4e16432-3df3-4325-b757-906fbbeca604 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:21:57.447758 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-6d9da5ba-3acc-4cfc-8a37-9ec31ec8519f req-0ec28776-276f-4925-a10e-a250f71c1454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ad1a46-8a77-4def-b880-e32ca5f36db1", "name": "network-vif-plugged", "status": "completed", "tag": "8634b263-44cb-4aa1-94a2-580363a6f345"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:21:57.456623 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-6d9da5ba-3acc-4cfc-8a37-9ec31ec8519f req-0ec28776-276f-4925-a10e-a250f71c1454 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:57.457082 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-6d9da5ba-3acc-4cfc-8a37-9ec31ec8519f req-0ec28776-276f-4925-a10e-a250f71c1454 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:57.467662 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-6d9da5ba-3acc-4cfc-8a37-9ec31ec8519f req-0ec28776-276f-4925-a10e-a250f71c1454 service nova] Creating event network-vif-plugged:8634b263-44cb-4aa1-94a2-580363a6f345 for instance f5ad1a46-8a77-4def-b880-e32ca5f36db1 on hv-cinder-81899 Apr 05 11:21:57.472646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-6d9da5ba-3acc-4cfc-8a37-9ec31ec8519f req-0ec28776-276f-4925-a10e-a250f71c1454 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028545 Apr 05 11:21:57.473220 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 506/1042] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:21:57.526418 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c1c0ccd1-a245-4d2f-824b-d845bc9398d2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:57.527262 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c1c0ccd1-a245-4d2f-824b-d845bc9398d2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:57.533622 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1c0ccd1-a245-4d2f-824b-d845bc9398d2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:57.534085 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1c0ccd1-a245-4d2f-824b-d845bc9398d2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:57.534897 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1c0ccd1-a245-4d2f-824b-d845bc9398d2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:57.535339 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1c0ccd1-a245-4d2f-824b-d845bc9398d2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:57.673655 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c1c0ccd1-a245-4d2f-824b-d845bc9398d2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:57.681202 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c1c0ccd1-a245-4d2f-824b-d845bc9398d2 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1362 microversion: 2.1 time: 0.158997 Apr 05 11:21:57.681746 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 507/1043] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:57 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:21:57.794578 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1d881123-f4b9-40df-9760-dc59985326d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "POST /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604/action" status: 202 len: 0 microversion: 2.1 time: 0.955560 Apr 05 11:21:57.795281 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 537/1044] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:21:56 2022] POST /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604/action => generated 0 bytes in 957 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:21:57.804139 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-05e02462-e4e3-43bc-8e5d-8d5e351aed28 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:57.804807 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-05e02462-e4e3-43bc-8e5d-8d5e351aed28 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:57.811389 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-05e02462-e4e3-43bc-8e5d-8d5e351aed28 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:57.811835 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-05e02462-e4e3-43bc-8e5d-8d5e351aed28 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:57.812655 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-05e02462-e4e3-43bc-8e5d-8d5e351aed28 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:57.813092 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-05e02462-e4e3-43bc-8e5d-8d5e351aed28 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:57.981653 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-05e02462-e4e3-43bc-8e5d-8d5e351aed28 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:57.989314 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-05e02462-e4e3-43bc-8e5d-8d5e351aed28 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.189774 Apr 05 11:21:57.989885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 508/1045] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:57 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:58.700272 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-01b38a68-3142-41c1-88d8-06672e98ce67 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:58.700967 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-01b38a68-3142-41c1-88d8-06672e98ce67 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:58.707242 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-01b38a68-3142-41c1-88d8-06672e98ce67 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:58.707692 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-01b38a68-3142-41c1-88d8-06672e98ce67 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:58.708459 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-01b38a68-3142-41c1-88d8-06672e98ce67 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:58.708898 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-01b38a68-3142-41c1-88d8-06672e98ce67 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:58.843912 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-01b38a68-3142-41c1-88d8-06672e98ce67 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:58.851484 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-01b38a68-3142-41c1-88d8-06672e98ce67 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1362 microversion: 2.1 time: 0.156560 Apr 05 11:21:58.852120 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 538/1046] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:58 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:59.007164 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a26a10f3-1ad6-4997-a6b3-6b4fa6b1ecaa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:59.007704 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a26a10f3-1ad6-4997-a6b3-6b4fa6b1ecaa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:59.014276 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a26a10f3-1ad6-4997-a6b3-6b4fa6b1ecaa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:59.014760 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a26a10f3-1ad6-4997-a6b3-6b4fa6b1ecaa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:59.015530 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a26a10f3-1ad6-4997-a6b3-6b4fa6b1ecaa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:59.015964 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a26a10f3-1ad6-4997-a6b3-6b4fa6b1ecaa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:59.149430 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a26a10f3-1ad6-4997-a6b3-6b4fa6b1ecaa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:21:59.158518 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a26a10f3-1ad6-4997-a6b3-6b4fa6b1ecaa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.155384 Apr 05 11:21:59.159118 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 509/1047] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:59 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:21:59.867954 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a0759127-8ccc-48c6-809c-e268cbc516f7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:21:59.868823 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a0759127-8ccc-48c6-809c-e268cbc516f7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:21:59.875877 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0759127-8ccc-48c6-809c-e268cbc516f7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:59.876334 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0759127-8ccc-48c6-809c-e268cbc516f7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:21:59.877114 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0759127-8ccc-48c6-809c-e268cbc516f7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:21:59.877578 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0759127-8ccc-48c6-809c-e268cbc516f7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:00.012446 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a0759127-8ccc-48c6-809c-e268cbc516f7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:00.019653 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a0759127-8ccc-48c6-809c-e268cbc516f7 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1362 microversion: 2.1 time: 0.155644 Apr 05 11:22:00.020220 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 539/1048] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:21:59 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:00.174909 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4d9d8654-16f0-4839-8d8e-fdbe9791624c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:00.175455 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4d9d8654-16f0-4839-8d8e-fdbe9791624c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:00.181813 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d9d8654-16f0-4839-8d8e-fdbe9791624c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:00.182258 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d9d8654-16f0-4839-8d8e-fdbe9791624c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:00.183050 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d9d8654-16f0-4839-8d8e-fdbe9791624c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:00.183482 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d9d8654-16f0-4839-8d8e-fdbe9791624c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:00.323781 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4d9d8654-16f0-4839-8d8e-fdbe9791624c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:00.330981 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4d9d8654-16f0-4839-8d8e-fdbe9791624c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.160089 Apr 05 11:22:00.331544 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 510/1049] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:00 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:01.035459 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-36aec796-25b4-4c59-9cb9-e86e2555c906 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:01.036080 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-36aec796-25b4-4c59-9cb9-e86e2555c906 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:01.042434 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-36aec796-25b4-4c59-9cb9-e86e2555c906 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:01.043529 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-36aec796-25b4-4c59-9cb9-e86e2555c906 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:01.044289 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-36aec796-25b4-4c59-9cb9-e86e2555c906 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:01.044721 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-36aec796-25b4-4c59-9cb9-e86e2555c906 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:01.174447 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-36aec796-25b4-4c59-9cb9-e86e2555c906 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:01.181988 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-36aec796-25b4-4c59-9cb9-e86e2555c906 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1548 microversion: 2.1 time: 0.150467 Apr 05 11:22:01.182554 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 540/1050] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:01 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:01.198247 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c8ea89cf-c2e1-4bb1-a629-3d7716831d90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:01.199314 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c8ea89cf-c2e1-4bb1-a629-3d7716831d90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:01.205754 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c8ea89cf-c2e1-4bb1-a629-3d7716831d90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:01.206206 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c8ea89cf-c2e1-4bb1-a629-3d7716831d90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:01.207018 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c8ea89cf-c2e1-4bb1-a629-3d7716831d90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:01.207579 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c8ea89cf-c2e1-4bb1-a629-3d7716831d90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:01.288905 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c8ea89cf-c2e1-4bb1-a629-3d7716831d90 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094460 Apr 05 11:22:01.289494 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 511/1051] 10.222.0.39 () {58 vars in 1274 bytes} [Tue Apr 5 11:22:01 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:22:01.348246 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1a4766e9-7d08-4866-8ffd-2b97eb9caee0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:01.348851 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1a4766e9-7d08-4866-8ffd-2b97eb9caee0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:01.354628 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a4766e9-7d08-4866-8ffd-2b97eb9caee0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:01.355097 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a4766e9-7d08-4866-8ffd-2b97eb9caee0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:01.355852 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a4766e9-7d08-4866-8ffd-2b97eb9caee0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:01.356282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a4766e9-7d08-4866-8ffd-2b97eb9caee0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:01.497644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1a4766e9-7d08-4866-8ffd-2b97eb9caee0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:01.505128 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1a4766e9-7d08-4866-8ffd-2b97eb9caee0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.160693 Apr 05 11:22:01.510949 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 541/1052] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:01 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:02.349164 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-2c800d5c-0b46-42ff-8a48-ecbafe8a103a req-d1db50ff-8516-47b1-aa48-a80e69abe2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5ad1a46-8a77-4def-b880-e32ca5f36db1", "tag": "8634b263-44cb-4aa1-94a2-580363a6f345"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:22:02.357752 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-2c800d5c-0b46-42ff-8a48-ecbafe8a103a req-d1db50ff-8516-47b1-aa48-a80e69abe2b1 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:02.358190 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-2c800d5c-0b46-42ff-8a48-ecbafe8a103a req-d1db50ff-8516-47b1-aa48-a80e69abe2b1 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:02.369377 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-2c800d5c-0b46-42ff-8a48-ecbafe8a103a req-d1db50ff-8516-47b1-aa48-a80e69abe2b1 service nova] Creating event network-changed:8634b263-44cb-4aa1-94a2-580363a6f345 for instance f5ad1a46-8a77-4def-b880-e32ca5f36db1 on hv-cinder-81899 Apr 05 11:22:02.374175 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-2c800d5c-0b46-42ff-8a48-ecbafe8a103a req-d1db50ff-8516-47b1-aa48-a80e69abe2b1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029276 Apr 05 11:22:02.374795 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 512/1053] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:22:02.522903 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-eccfeeaf-0907-4172-8d80-1579d5d9e9f8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:02.523617 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-eccfeeaf-0907-4172-8d80-1579d5d9e9f8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:02.530349 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eccfeeaf-0907-4172-8d80-1579d5d9e9f8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:02.530839 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eccfeeaf-0907-4172-8d80-1579d5d9e9f8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:02.531615 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eccfeeaf-0907-4172-8d80-1579d5d9e9f8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:02.532048 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eccfeeaf-0907-4172-8d80-1579d5d9e9f8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:02.672529 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-eccfeeaf-0907-4172-8d80-1579d5d9e9f8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:02.680116 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-eccfeeaf-0907-4172-8d80-1579d5d9e9f8 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.161259 Apr 05 11:22:02.680809 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 542/1054] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:02 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:03.697658 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a23907c4-5311-4a84-b413-5d8f1534bb5c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:03.698478 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a23907c4-5311-4a84-b413-5d8f1534bb5c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:03.704896 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a23907c4-5311-4a84-b413-5d8f1534bb5c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:03.705345 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a23907c4-5311-4a84-b413-5d8f1534bb5c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:03.706201 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a23907c4-5311-4a84-b413-5d8f1534bb5c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:03.706541 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a23907c4-5311-4a84-b413-5d8f1534bb5c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:03.844164 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a23907c4-5311-4a84-b413-5d8f1534bb5c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:03.851629 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a23907c4-5311-4a84-b413-5d8f1534bb5c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.158823 Apr 05 11:22:03.852226 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 513/1055] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:03 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:04.869371 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7855ec7d-5ede-4341-9b2f-5b9b878eda0a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:04.869987 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7855ec7d-5ede-4341-9b2f-5b9b878eda0a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:04.876845 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7855ec7d-5ede-4341-9b2f-5b9b878eda0a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:04.877288 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7855ec7d-5ede-4341-9b2f-5b9b878eda0a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:04.878049 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7855ec7d-5ede-4341-9b2f-5b9b878eda0a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:04.878484 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7855ec7d-5ede-4341-9b2f-5b9b878eda0a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:05.015481 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7855ec7d-5ede-4341-9b2f-5b9b878eda0a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:05.023049 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7855ec7d-5ede-4341-9b2f-5b9b878eda0a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.157578 Apr 05 11:22:05.023632 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 543/1056] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:04 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:06.039343 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f7488e1c-c588-436e-ab8a-d2ce51cb6454 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:06.039936 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f7488e1c-c588-436e-ab8a-d2ce51cb6454 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:06.046241 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7488e1c-c588-436e-ab8a-d2ce51cb6454 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:06.046716 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7488e1c-c588-436e-ab8a-d2ce51cb6454 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:06.047477 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7488e1c-c588-436e-ab8a-d2ce51cb6454 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:06.047909 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7488e1c-c588-436e-ab8a-d2ce51cb6454 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:06.179894 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f7488e1c-c588-436e-ab8a-d2ce51cb6454 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:06.187885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f7488e1c-c588-436e-ab8a-d2ce51cb6454 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.152385 Apr 05 11:22:06.188489 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 514/1057] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:06 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:07.206723 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c095b83c-7c71-4701-a510-d262ce77cfc4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:07.207324 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c095b83c-7c71-4701-a510-d262ce77cfc4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:07.213813 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c095b83c-7c71-4701-a510-d262ce77cfc4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:07.214253 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c095b83c-7c71-4701-a510-d262ce77cfc4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:07.215037 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c095b83c-7c71-4701-a510-d262ce77cfc4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:07.216045 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c095b83c-7c71-4701-a510-d262ce77cfc4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:07.351878 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c095b83c-7c71-4701-a510-d262ce77cfc4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:07.359473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c095b83c-7c71-4701-a510-d262ce77cfc4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.157722 Apr 05 11:22:07.360052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 544/1058] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:07 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:08.377429 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-36053915-4fe1-49b1-b2d7-e43a63a78662 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:08.378042 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-36053915-4fe1-49b1-b2d7-e43a63a78662 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:08.384536 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36053915-4fe1-49b1-b2d7-e43a63a78662 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:08.384987 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36053915-4fe1-49b1-b2d7-e43a63a78662 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:08.385774 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36053915-4fe1-49b1-b2d7-e43a63a78662 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:08.386211 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36053915-4fe1-49b1-b2d7-e43a63a78662 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:08.836899 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-36053915-4fe1-49b1-b2d7-e43a63a78662 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:08.844921 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-36053915-4fe1-49b1-b2d7-e43a63a78662 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.471524 Apr 05 11:22:08.845511 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 515/1059] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:08 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:09.863298 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f744c04d-251e-4957-89fb-cdbe6ee2897d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:09.863870 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f744c04d-251e-4957-89fb-cdbe6ee2897d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:09.870057 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f744c04d-251e-4957-89fb-cdbe6ee2897d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:09.870504 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f744c04d-251e-4957-89fb-cdbe6ee2897d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:09.871291 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f744c04d-251e-4957-89fb-cdbe6ee2897d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:09.871721 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f744c04d-251e-4957-89fb-cdbe6ee2897d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:10.002862 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f744c04d-251e-4957-89fb-cdbe6ee2897d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:10.010426 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f744c04d-251e-4957-89fb-cdbe6ee2897d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.151372 Apr 05 11:22:10.011017 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 545/1060] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:09 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:11.027602 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0a0dcb1b-f029-440a-9b7a-8793b1946bb3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:11.028237 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0a0dcb1b-f029-440a-9b7a-8793b1946bb3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:11.035160 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a0dcb1b-f029-440a-9b7a-8793b1946bb3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:11.035533 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a0dcb1b-f029-440a-9b7a-8793b1946bb3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:11.036322 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a0dcb1b-f029-440a-9b7a-8793b1946bb3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:11.036766 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a0dcb1b-f029-440a-9b7a-8793b1946bb3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:11.174089 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0a0dcb1b-f029-440a-9b7a-8793b1946bb3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:11.181542 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0a0dcb1b-f029-440a-9b7a-8793b1946bb3 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.157830 Apr 05 11:22:11.182124 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 516/1061] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:11 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:12.199429 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-11c75d34-602f-4a00-b684-299bcd877b31 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:12.200809 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-11c75d34-602f-4a00-b684-299bcd877b31 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:12.207009 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11c75d34-602f-4a00-b684-299bcd877b31 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:12.210065 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11c75d34-602f-4a00-b684-299bcd877b31 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:12.210065 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11c75d34-602f-4a00-b684-299bcd877b31 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:12.210065 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11c75d34-602f-4a00-b684-299bcd877b31 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:12.347674 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-11c75d34-602f-4a00-b684-299bcd877b31 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:12.355001 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-11c75d34-602f-4a00-b684-299bcd877b31 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.159512 Apr 05 11:22:12.355561 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 546/1062] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:12 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:13.372129 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d35ac148-46a6-44af-9c53-cebe312be51a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:13.372740 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d35ac148-46a6-44af-9c53-cebe312be51a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:13.379218 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d35ac148-46a6-44af-9c53-cebe312be51a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:13.379669 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d35ac148-46a6-44af-9c53-cebe312be51a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:13.380440 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d35ac148-46a6-44af-9c53-cebe312be51a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:13.380877 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d35ac148-46a6-44af-9c53-cebe312be51a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:13.512529 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d35ac148-46a6-44af-9c53-cebe312be51a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:13.519859 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d35ac148-46a6-44af-9c53-cebe312be51a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1510 microversion: 2.1 time: 0.151626 Apr 05 11:22:13.520423 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 517/1063] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:13 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:13.536775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9a07f298-bc99-4c80-99e9-e498b25e0700 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:22:13.537514 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9a07f298-bc99-4c80-99e9-e498b25e0700 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:13.543904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a07f298-bc99-4c80-99e9-e498b25e0700 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:13.544288 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a07f298-bc99-4c80-99e9-e498b25e0700 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:13.545043 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a07f298-bc99-4c80-99e9-e498b25e0700 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:13.545476 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a07f298-bc99-4c80-99e9-e498b25e0700 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:13.751867 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9a07f298-bc99-4c80-99e9-e498b25e0700 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "POST /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604/action" status: 202 len: 0 microversion: 2.1 time: 0.219181 Apr 05 11:22:13.752681 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 547/1064] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:22:13 2022] POST /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:22:13.761027 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-638c6022-5573-43e7-b625-8ac639f2e7af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:13.761646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-638c6022-5573-43e7-b625-8ac639f2e7af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:13.768110 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-638c6022-5573-43e7-b625-8ac639f2e7af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:13.768562 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-638c6022-5573-43e7-b625-8ac639f2e7af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:13.769336 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-638c6022-5573-43e7-b625-8ac639f2e7af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:13.769772 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-638c6022-5573-43e7-b625-8ac639f2e7af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:13.904864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-638c6022-5573-43e7-b625-8ac639f2e7af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:13.912356 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-638c6022-5573-43e7-b625-8ac639f2e7af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1518 microversion: 2.1 time: 0.155465 Apr 05 11:22:13.912921 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 518/1065] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:13 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:14.930444 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9595ce5c-d0ab-4c43-adb7-be024079ba98 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:14.931102 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9595ce5c-d0ab-4c43-adb7-be024079ba98 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:14.938300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9595ce5c-d0ab-4c43-adb7-be024079ba98 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:14.938795 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9595ce5c-d0ab-4c43-adb7-be024079ba98 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:14.939580 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9595ce5c-d0ab-4c43-adb7-be024079ba98 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:14.940016 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9595ce5c-d0ab-4c43-adb7-be024079ba98 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:15.075022 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9595ce5c-d0ab-4c43-adb7-be024079ba98 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:15.082411 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9595ce5c-d0ab-4c43-adb7-be024079ba98 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1518 microversion: 2.1 time: 0.155890 Apr 05 11:22:15.083309 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 548/1066] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:14 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:22:15.138219 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-07e67306-6045-47f3-ad1b-9443204c6360 req-89bb7a34-2e5c-4754-8941-6cf5778a6ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4e16432-3df3-4325-b757-906fbbeca604", "name": "network-vif-unplugged", "status": "completed", "tag": "dc377578-0184-4a80-88e0-2385eab5c0c4"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:22:15.146575 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-07e67306-6045-47f3-ad1b-9443204c6360 req-89bb7a34-2e5c-4754-8941-6cf5778a6ed8 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:15.147062 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-07e67306-6045-47f3-ad1b-9443204c6360 req-89bb7a34-2e5c-4754-8941-6cf5778a6ed8 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:15.158268 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.compute.server_external_events [req-07e67306-6045-47f3-ad1b-9443204c6360 req-89bb7a34-2e5c-4754-8941-6cf5778a6ed8 service nova] Unable to find a host for instance e4e16432-3df3-4325-b757-906fbbeca604. Dropping event network-vif-unplugged {{(pid=117594) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 05 11:22:15.159180 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-07e67306-6045-47f3-ad1b-9443204c6360 req-89bb7a34-2e5c-4754-8941-6cf5778a6ed8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024854 Apr 05 11:22:15.159755 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 519/1067] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 05 11:22:16.100169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d80fb9e6-68ba-4d7a-8b61-95d2f9d3db63 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:16.100774 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d80fb9e6-68ba-4d7a-8b61-95d2f9d3db63 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:16.107118 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d80fb9e6-68ba-4d7a-8b61-95d2f9d3db63 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:16.107736 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d80fb9e6-68ba-4d7a-8b61-95d2f9d3db63 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:16.108557 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d80fb9e6-68ba-4d7a-8b61-95d2f9d3db63 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:16.108994 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d80fb9e6-68ba-4d7a-8b61-95d2f9d3db63 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:16.253583 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d80fb9e6-68ba-4d7a-8b61-95d2f9d3db63 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:16.258277 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d80fb9e6-68ba-4d7a-8b61-95d2f9d3db63 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1520 microversion: 2.1 time: 0.161954 Apr 05 11:22:16.258886 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 549/1068] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:16 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:17.275504 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6c97d774-07cf-4ac8-8447-ebc381554441 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:17.276122 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6c97d774-07cf-4ac8-8447-ebc381554441 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:17.283152 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6c97d774-07cf-4ac8-8447-ebc381554441 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:17.283605 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6c97d774-07cf-4ac8-8447-ebc381554441 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:17.284396 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6c97d774-07cf-4ac8-8447-ebc381554441 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:17.284839 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6c97d774-07cf-4ac8-8447-ebc381554441 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:17.422460 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6c97d774-07cf-4ac8-8447-ebc381554441 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:17.429798 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6c97d774-07cf-4ac8-8447-ebc381554441 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1576 microversion: 2.1 time: 0.158236 Apr 05 11:22:17.430364 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 520/1069] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:17 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:18.447544 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2d32128a-025a-48ff-8fe2-cdcb7c100d20 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:18.448154 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2d32128a-025a-48ff-8fe2-cdcb7c100d20 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:18.454755 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2d32128a-025a-48ff-8fe2-cdcb7c100d20 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:18.455208 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2d32128a-025a-48ff-8fe2-cdcb7c100d20 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:18.455971 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2d32128a-025a-48ff-8fe2-cdcb7c100d20 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:18.456403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2d32128a-025a-48ff-8fe2-cdcb7c100d20 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:18.589069 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2d32128a-025a-48ff-8fe2-cdcb7c100d20 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:18.597145 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2d32128a-025a-48ff-8fe2-cdcb7c100d20 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1576 microversion: 2.1 time: 0.153713 Apr 05 11:22:18.597711 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 550/1070] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:18 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:19.615188 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5cbe2464-dc73-4852-9ae2-573256e47a1d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:19.615739 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5cbe2464-dc73-4852-9ae2-573256e47a1d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:19.622144 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5cbe2464-dc73-4852-9ae2-573256e47a1d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:19.622594 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5cbe2464-dc73-4852-9ae2-573256e47a1d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:19.623419 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5cbe2464-dc73-4852-9ae2-573256e47a1d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:19.623850 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5cbe2464-dc73-4852-9ae2-573256e47a1d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:19.756751 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5cbe2464-dc73-4852-9ae2-573256e47a1d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:19.764422 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5cbe2464-dc73-4852-9ae2-573256e47a1d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1576 microversion: 2.1 time: 0.153452 Apr 05 11:22:19.766601 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 521/1071] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:19 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:20.781717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ad033c77-991d-4ee2-8347-eefa7b64d3af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:20.782303 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ad033c77-991d-4ee2-8347-eefa7b64d3af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:20.788545 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad033c77-991d-4ee2-8347-eefa7b64d3af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:20.788990 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad033c77-991d-4ee2-8347-eefa7b64d3af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:20.789742 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad033c77-991d-4ee2-8347-eefa7b64d3af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:20.790184 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad033c77-991d-4ee2-8347-eefa7b64d3af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:20.925556 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ad033c77-991d-4ee2-8347-eefa7b64d3af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:20.932982 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ad033c77-991d-4ee2-8347-eefa7b64d3af tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1576 microversion: 2.1 time: 0.155746 Apr 05 11:22:20.933709 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 551/1072] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:20 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:21.949916 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5b184227-a7c8-440d-8855-711da05042a1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:21.950517 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5b184227-a7c8-440d-8855-711da05042a1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:21.957547 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5b184227-a7c8-440d-8855-711da05042a1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:21.957990 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5b184227-a7c8-440d-8855-711da05042a1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:21.958783 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5b184227-a7c8-440d-8855-711da05042a1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:21.959217 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5b184227-a7c8-440d-8855-711da05042a1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:22.101939 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5b184227-a7c8-440d-8855-711da05042a1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:22.109295 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5b184227-a7c8-440d-8855-711da05042a1 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1576 microversion: 2.1 time: 0.163281 Apr 05 11:22:22.110502 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 522/1073] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:21 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:23.129365 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-66f9a51e-7785-4ce4-962c-6fc1501f3f74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:23.129973 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-66f9a51e-7785-4ce4-962c-6fc1501f3f74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:23.136327 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66f9a51e-7785-4ce4-962c-6fc1501f3f74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:23.136773 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66f9a51e-7785-4ce4-962c-6fc1501f3f74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:23.137533 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66f9a51e-7785-4ce4-962c-6fc1501f3f74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:23.137968 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66f9a51e-7785-4ce4-962c-6fc1501f3f74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:23.276040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-66f9a51e-7785-4ce4-962c-6fc1501f3f74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:23.289554 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-66f9a51e-7785-4ce4-962c-6fc1501f3f74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1576 microversion: 2.1 time: 0.164906 Apr 05 11:22:23.301803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 552/1074] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:23 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:24.307835 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9e4eb92e-3def-4842-b424-18d489279ad4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:24.308440 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9e4eb92e-3def-4842-b424-18d489279ad4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:24.314337 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9e4eb92e-3def-4842-b424-18d489279ad4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:24.314824 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9e4eb92e-3def-4842-b424-18d489279ad4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:24.315582 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9e4eb92e-3def-4842-b424-18d489279ad4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:24.316024 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9e4eb92e-3def-4842-b424-18d489279ad4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:24.450331 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9e4eb92e-3def-4842-b424-18d489279ad4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:24.458045 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9e4eb92e-3def-4842-b424-18d489279ad4 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1576 microversion: 2.1 time: 0.154588 Apr 05 11:22:24.458619 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 523/1075] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:24 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:25.475824 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-57816ae1-edbd-4af6-a95c-0edfe3b1031c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:25.476436 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-57816ae1-edbd-4af6-a95c-0edfe3b1031c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:25.482835 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57816ae1-edbd-4af6-a95c-0edfe3b1031c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:25.485437 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57816ae1-edbd-4af6-a95c-0edfe3b1031c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:25.485437 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57816ae1-edbd-4af6-a95c-0edfe3b1031c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:25.485437 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57816ae1-edbd-4af6-a95c-0edfe3b1031c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:25.616682 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-57816ae1-edbd-4af6-a95c-0edfe3b1031c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:25.624194 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-57816ae1-edbd-4af6-a95c-0edfe3b1031c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1576 microversion: 2.1 time: 0.152349 Apr 05 11:22:25.624780 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 553/1076] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:25 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:26.641248 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2e2e70c0-7587-4579-bc99-34f273163aee tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:26.641821 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2e2e70c0-7587-4579-bc99-34f273163aee tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:26.648265 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2e2e70c0-7587-4579-bc99-34f273163aee tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:26.648750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2e2e70c0-7587-4579-bc99-34f273163aee tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:26.649481 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2e2e70c0-7587-4579-bc99-34f273163aee tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:26.649922 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2e2e70c0-7587-4579-bc99-34f273163aee tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:26.784169 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2e2e70c0-7587-4579-bc99-34f273163aee tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:26.791411 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2e2e70c0-7587-4579-bc99-34f273163aee tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1576 microversion: 2.1 time: 0.154178 Apr 05 11:22:26.791988 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 524/1077] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:26 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:27.809437 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-db8ccd5a-4d56-4df2-83fb-b8f4af839eef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:27.810048 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-db8ccd5a-4d56-4df2-83fb-b8f4af839eef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:27.816381 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db8ccd5a-4d56-4df2-83fb-b8f4af839eef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:27.816832 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db8ccd5a-4d56-4df2-83fb-b8f4af839eef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:27.817595 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db8ccd5a-4d56-4df2-83fb-b8f4af839eef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:27.818031 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db8ccd5a-4d56-4df2-83fb-b8f4af839eef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:27.952665 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db8ccd5a-4d56-4df2-83fb-b8f4af839eef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:27.960510 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-db8ccd5a-4d56-4df2-83fb-b8f4af839eef tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1576 microversion: 2.1 time: 0.155229 Apr 05 11:22:27.961081 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 554/1078] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:27 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:28.977693 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e4cb8cf2-cb42-4138-a25d-094cd39a90aa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:28.978290 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e4cb8cf2-cb42-4138-a25d-094cd39a90aa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:28.984861 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e4cb8cf2-cb42-4138-a25d-094cd39a90aa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:28.985309 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e4cb8cf2-cb42-4138-a25d-094cd39a90aa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:28.986076 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e4cb8cf2-cb42-4138-a25d-094cd39a90aa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:28.986801 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e4cb8cf2-cb42-4138-a25d-094cd39a90aa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:29.118754 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e4cb8cf2-cb42-4138-a25d-094cd39a90aa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:29.126414 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e4cb8cf2-cb42-4138-a25d-094cd39a90aa tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1576 microversion: 2.1 time: 0.153047 Apr 05 11:22:29.127018 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 525/1079] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:28 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:29.277508 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-be4cb4d9-dae8-44b6-9855-0a7c109c92e8 req-03ea0708-22d8-487d-b30e-fc2c79a0c38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4e16432-3df3-4325-b757-906fbbeca604", "name": "network-vif-plugged", "status": "completed", "tag": "dc377578-0184-4a80-88e0-2385eab5c0c4"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:22:29.286422 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-be4cb4d9-dae8-44b6-9855-0a7c109c92e8 req-03ea0708-22d8-487d-b30e-fc2c79a0c38b service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:29.292639 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-be4cb4d9-dae8-44b6-9855-0a7c109c92e8 req-03ea0708-22d8-487d-b30e-fc2c79a0c38b service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:29.298213 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-be4cb4d9-dae8-44b6-9855-0a7c109c92e8 req-03ea0708-22d8-487d-b30e-fc2c79a0c38b service nova] Creating event network-vif-plugged:dc377578-0184-4a80-88e0-2385eab5c0c4 for instance e4e16432-3df3-4325-b757-906fbbeca604 on hv-cinder-81899 Apr 05 11:22:29.303267 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-be4cb4d9-dae8-44b6-9855-0a7c109c92e8 req-03ea0708-22d8-487d-b30e-fc2c79a0c38b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029641 Apr 05 11:22:29.303937 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 555/1080] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:22:30.144115 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f81f63da-8d01-4c1d-b3b9-bcbc3012139e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:30.144733 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f81f63da-8d01-4c1d-b3b9-bcbc3012139e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:30.151897 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f81f63da-8d01-4c1d-b3b9-bcbc3012139e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:30.152353 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f81f63da-8d01-4c1d-b3b9-bcbc3012139e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:30.153127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f81f63da-8d01-4c1d-b3b9-bcbc3012139e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:30.153571 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f81f63da-8d01-4c1d-b3b9-bcbc3012139e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:30.289906 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f81f63da-8d01-4c1d-b3b9-bcbc3012139e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:30.297865 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f81f63da-8d01-4c1d-b3b9-bcbc3012139e tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1576 microversion: 2.1 time: 0.157782 Apr 05 11:22:30.298463 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 526/1081] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:30 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:31.316782 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-376899a7-e8a5-437e-a10a-1760c2ccdbb0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:31.317474 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-376899a7-e8a5-437e-a10a-1760c2ccdbb0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:31.324106 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-376899a7-e8a5-437e-a10a-1760c2ccdbb0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:31.324570 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-376899a7-e8a5-437e-a10a-1760c2ccdbb0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:31.325327 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-376899a7-e8a5-437e-a10a-1760c2ccdbb0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:31.325757 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-376899a7-e8a5-437e-a10a-1760c2ccdbb0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:31.460679 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-376899a7-e8a5-437e-a10a-1760c2ccdbb0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:31.467966 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-376899a7-e8a5-437e-a10a-1760c2ccdbb0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1576 microversion: 2.1 time: 0.155819 Apr 05 11:22:31.468681 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 556/1082] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:31 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:32.485078 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-71bbe67d-6ee0-4845-964a-51d6445fbb3c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:32.485737 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-71bbe67d-6ee0-4845-964a-51d6445fbb3c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:32.492355 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-71bbe67d-6ee0-4845-964a-51d6445fbb3c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:32.492802 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-71bbe67d-6ee0-4845-964a-51d6445fbb3c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:32.493572 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-71bbe67d-6ee0-4845-964a-51d6445fbb3c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:32.494003 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-71bbe67d-6ee0-4845-964a-51d6445fbb3c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:32.629856 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-71bbe67d-6ee0-4845-964a-51d6445fbb3c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:32.637356 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-71bbe67d-6ee0-4845-964a-51d6445fbb3c tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1563 microversion: 2.1 time: 0.156246 Apr 05 11:22:32.638042 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 527/1083] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:32 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:53.707556 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9072c41b-5786-4be4-8ef4-acb881305142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:53.708096 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9072c41b-5786-4be4-8ef4-acb881305142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:53.714064 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9072c41b-5786-4be4-8ef4-acb881305142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:53.714504 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9072c41b-5786-4be4-8ef4-acb881305142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:53.715304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9072c41b-5786-4be4-8ef4-acb881305142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:53.715739 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9072c41b-5786-4be4-8ef4-acb881305142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:53.792924 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-9072c41b-5786-4be4-8ef4-acb881305142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lazy-loading 'services' on Instance uuid 0d7680ed-da15-498a-a57d-a37e492ada5b {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:22:54.035949 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9072c41b-5786-4be4-8ef4-acb881305142 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-volume_attachments/4b3c2cbb-29d0-4c7e-aab7-13095307ff04" status: 202 len: 0 microversion: 2.1 time: 0.332183 Apr 05 11:22:54.036543 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 557/1084] 10.222.0.39 () {58 vars in 1415 bytes} [Tue Apr 5 11:22:53 2022] DELETE /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-volume_attachments/4b3c2cbb-29d0-4c7e-aab7-13095307ff04 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:22:54.045227 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5efb6ee3-b615-46e8-a0cb-0aeecad19bcf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:54.046163 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5efb6ee3-b615-46e8-a0cb-0aeecad19bcf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:54.052461 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5efb6ee3-b615-46e8-a0cb-0aeecad19bcf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:54.052922 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5efb6ee3-b615-46e8-a0cb-0aeecad19bcf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:54.053705 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5efb6ee3-b615-46e8-a0cb-0aeecad19bcf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:54.054149 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5efb6ee3-b615-46e8-a0cb-0aeecad19bcf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:54.083942 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5efb6ee3-b615-46e8-a0cb-0aeecad19bcf tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042755 Apr 05 11:22:54.084516 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 528/1085] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:22:54 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:22:55.096599 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9a170aae-5dd2-44fb-b782-d98c7f8e4a27 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:55.097595 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9a170aae-5dd2-44fb-b782-d98c7f8e4a27 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:55.103686 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a170aae-5dd2-44fb-b782-d98c7f8e4a27 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:55.104132 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a170aae-5dd2-44fb-b782-d98c7f8e4a27 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:55.104886 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a170aae-5dd2-44fb-b782-d98c7f8e4a27 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:55.105316 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a170aae-5dd2-44fb-b782-d98c7f8e4a27 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:55.132909 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9a170aae-5dd2-44fb-b782-d98c7f8e4a27 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041877 Apr 05 11:22:55.133469 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 558/1086] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:22:55 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:22:56.144540 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2deb24a6-9179-4e08-807f-a53f21f3af49 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:56.145465 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2deb24a6-9179-4e08-807f-a53f21f3af49 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:56.151735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2deb24a6-9179-4e08-807f-a53f21f3af49 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:56.152184 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2deb24a6-9179-4e08-807f-a53f21f3af49 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:56.153037 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2deb24a6-9179-4e08-807f-a53f21f3af49 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:56.153475 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2deb24a6-9179-4e08-807f-a53f21f3af49 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:56.182340 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2deb24a6-9179-4e08-807f-a53f21f3af49 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041804 Apr 05 11:22:56.182948 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 529/1087] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:22:56 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:22:56.255964 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c4c8318e-d169-45fd-b579-c74e1e3f0e30 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:56.256520 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c4c8318e-d169-45fd-b579-c74e1e3f0e30 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:56.262844 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4c8318e-d169-45fd-b579-c74e1e3f0e30 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:56.263295 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4c8318e-d169-45fd-b579-c74e1e3f0e30 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:56.264054 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4c8318e-d169-45fd-b579-c74e1e3f0e30 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:56.264491 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4c8318e-d169-45fd-b579-c74e1e3f0e30 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:56.289944 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c4c8318e-d169-45fd-b579-c74e1e3f0e30 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:22:56.648629 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c4c8318e-d169-45fd-b579-c74e1e3f0e30 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 204 len: 0 microversion: 2.1 time: 0.396155 Apr 05 11:22:56.649216 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 559/1088] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:22:56 2022] DELETE /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:22:56.657184 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2879fa2b-13f8-4950-8ddc-fb24c9fe5b1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:56.665700 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2879fa2b-13f8-4950-8ddc-fb24c9fe5b1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:56.665700 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2879fa2b-13f8-4950-8ddc-fb24c9fe5b1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:56.665700 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2879fa2b-13f8-4950-8ddc-fb24c9fe5b1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:56.665700 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2879fa2b-13f8-4950-8ddc-fb24c9fe5b1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:56.666108 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2879fa2b-13f8-4950-8ddc-fb24c9fe5b1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:56.802182 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2879fa2b-13f8-4950-8ddc-fb24c9fe5b1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:56.809619 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2879fa2b-13f8-4950-8ddc-fb24c9fe5b1b tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1688 microversion: 2.1 time: 0.156254 Apr 05 11:22:56.810189 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 530/1089] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:56 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:57.827387 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-548064b4-51a8-4de9-aea4-586a7d86021d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:57.828126 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-548064b4-51a8-4de9-aea4-586a7d86021d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:57.835147 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-548064b4-51a8-4de9-aea4-586a7d86021d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:57.835599 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-548064b4-51a8-4de9-aea4-586a7d86021d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:57.836360 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-548064b4-51a8-4de9-aea4-586a7d86021d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:57.836801 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-548064b4-51a8-4de9-aea4-586a7d86021d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:57.971938 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-548064b4-51a8-4de9-aea4-586a7d86021d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:57.979228 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-548064b4-51a8-4de9-aea4-586a7d86021d tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1688 microversion: 2.1 time: 0.156319 Apr 05 11:22:57.979786 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 560/1090] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:57 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:22:58.997012 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-be1da891-ed27-4d87-994e-5518fda58518 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:22:58.997623 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-be1da891-ed27-4d87-994e-5518fda58518 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:22:59.004682 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be1da891-ed27-4d87-994e-5518fda58518 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:59.005130 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be1da891-ed27-4d87-994e-5518fda58518 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:59.006010 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be1da891-ed27-4d87-994e-5518fda58518 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:22:59.006441 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be1da891-ed27-4d87-994e-5518fda58518 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:22:59.136406 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-be1da891-ed27-4d87-994e-5518fda58518 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:22:59.143890 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-be1da891-ed27-4d87-994e-5518fda58518 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1688 microversion: 2.1 time: 0.150728 Apr 05 11:22:59.144460 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 531/1091] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:22:58 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:00.160879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d0f4bdd1-943c-4b15-8e35-81603ae27df9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:00.161489 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d0f4bdd1-943c-4b15-8e35-81603ae27df9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:00.168080 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0f4bdd1-943c-4b15-8e35-81603ae27df9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:00.168527 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0f4bdd1-943c-4b15-8e35-81603ae27df9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:00.169299 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0f4bdd1-943c-4b15-8e35-81603ae27df9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:00.169732 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0f4bdd1-943c-4b15-8e35-81603ae27df9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:00.300497 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d0f4bdd1-943c-4b15-8e35-81603ae27df9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:00.307763 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d0f4bdd1-943c-4b15-8e35-81603ae27df9 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1688 microversion: 2.1 time: 0.150954 Apr 05 11:23:00.308330 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 561/1092] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:00 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:01.329360 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9e5926ac-5689-466c-a29e-973783e43092 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:01.330274 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9e5926ac-5689-466c-a29e-973783e43092 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:01.337396 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9e5926ac-5689-466c-a29e-973783e43092 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:01.337855 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9e5926ac-5689-466c-a29e-973783e43092 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:01.338647 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9e5926ac-5689-466c-a29e-973783e43092 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:01.339093 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9e5926ac-5689-466c-a29e-973783e43092 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:01.377148 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-e25c156a-0e7d-47cb-bdd0-ab4cd99b7397 req-cd029b6f-4869-46b6-b93d-ac40ab48d921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7680ed-da15-498a-a57d-a37e492ada5b", "name": "network-vif-deleted", "tag": "141f21be-2523-4672-a366-4a146e7780e9"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:01.390688 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-e25c156a-0e7d-47cb-bdd0-ab4cd99b7397 req-cd029b6f-4869-46b6-b93d-ac40ab48d921 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:01.392016 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-e25c156a-0e7d-47cb-bdd0-ab4cd99b7397 req-cd029b6f-4869-46b6-b93d-ac40ab48d921 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:01.403892 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9e5926ac-5689-466c-a29e-973783e43092 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:01.405156 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-e25c156a-0e7d-47cb-bdd0-ab4cd99b7397 req-cd029b6f-4869-46b6-b93d-ac40ab48d921 service nova] Creating event network-vif-deleted:141f21be-2523-4672-a366-4a146e7780e9 for instance 0d7680ed-da15-498a-a57d-a37e492ada5b on hv-cinder-81899 Apr 05 11:23:01.410822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-e25c156a-0e7d-47cb-bdd0-ab4cd99b7397 req-cd029b6f-4869-46b6-b93d-ac40ab48d921 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037397 Apr 05 11:23:01.411984 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 562/1093] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:23:01.412102 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9e5926ac-5689-466c-a29e-973783e43092 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1620 microversion: 2.1 time: 0.090127 Apr 05 11:23:01.412599 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 532/1094] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:01 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1620 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:02.429469 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-aa216793-5809-4b04-bae5-51b803491b00 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:02.430264 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-aa216793-5809-4b04-bae5-51b803491b00 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:02.436918 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aa216793-5809-4b04-bae5-51b803491b00 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:02.437441 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aa216793-5809-4b04-bae5-51b803491b00 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:02.438321 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aa216793-5809-4b04-bae5-51b803491b00 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:02.438866 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aa216793-5809-4b04-bae5-51b803491b00 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:02.469717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aa216793-5809-4b04-bae5-51b803491b00 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:02.470191 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aa216793-5809-4b04-bae5-51b803491b00 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:02.470800 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-aa216793-5809-4b04-bae5-51b803491b00 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lazy-loading 'fault' on Instance uuid 0d7680ed-da15-498a-a57d-a37e492ada5b {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:23:02.512637 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-aa216793-5809-4b04-bae5-51b803491b00 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:02.520165 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-aa216793-5809-4b04-bae5-51b803491b00 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 200 len: 1334 microversion: 2.1 time: 0.094965 Apr 05 11:23:02.529194 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 563/1095] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:02 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 1334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:23:03.536785 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1acd7cc2-8f35-4ce9-bbbb-28d78a80bb35 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:03.537981 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1acd7cc2-8f35-4ce9-bbbb-28d78a80bb35 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 0d7680ed-da15-498a-a57d-a37e492ada5b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:03.544419 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1acd7cc2-8f35-4ce9-bbbb-28d78a80bb35 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:03.544922 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1acd7cc2-8f35-4ce9-bbbb-28d78a80bb35 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:03.545683 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1acd7cc2-8f35-4ce9-bbbb-28d78a80bb35 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:03.546119 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1acd7cc2-8f35-4ce9-bbbb-28d78a80bb35 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:03.558848 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-1acd7cc2-8f35-4ce9-bbbb-28d78a80bb35 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] HTTP exception thrown: Instance 0d7680ed-da15-498a-a57d-a37e492ada5b could not be found. Apr 05 11:23:03.559423 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1acd7cc2-8f35-4ce9-bbbb-28d78a80bb35 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Returning 404 to user: Instance 0d7680ed-da15-498a-a57d-a37e492ada5b could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:23:03.560261 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1acd7cc2-8f35-4ce9-bbbb-28d78a80bb35 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b" status: 404 len: 111 microversion: 2.1 time: 0.027431 Apr 05 11:23:03.560811 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 533/1096] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:03 2022] GET /compute/v2.1/servers/0d7680ed-da15-498a-a57d-a37e492ada5b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:23:03.569540 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1fe8fee3-585f-4c08-a374-f697b9db5796 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '.version_select at 0x7fec0c1488b0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:03.683477 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1fe8fee3-585f-4c08-a374-f697b9db5796 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807568226" status: 202 len: 0 microversion: 2.1 time: 0.118158 Apr 05 11:23:03.684057 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 564/1097] 10.222.0.39 () {58 vars in 1217 bytes} [Tue Apr 5 11:23:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807568226 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:23:06.389150 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eacb3eba-713d-42ab-8443-5bb2c055286a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:06.389646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eacb3eba-713d-42ab-8443-5bb2c055286a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:06.395645 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eacb3eba-713d-42ab-8443-5bb2c055286a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:06.396102 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eacb3eba-713d-42ab-8443-5bb2c055286a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:06.396854 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eacb3eba-713d-42ab-8443-5bb2c055286a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:06.397283 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eacb3eba-713d-42ab-8443-5bb2c055286a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:06.418892 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eacb3eba-713d-42ab-8443-5bb2c055286a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/ips" status: 200 len: 150 microversion: 2.1 time: 0.033480 Apr 05 11:23:06.419444 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 534/1098] 10.222.0.39 () {58 vars in 1247 bytes} [Tue Apr 5 11:23:06 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/ips => generated 150 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:07.096363 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-393042e1-4fa7-40f0-878b-b26091ed9e2a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:07.096838 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-393042e1-4fa7-40f0-878b-b26091ed9e2a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:07.105714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-393042e1-4fa7-40f0-878b-b26091ed9e2a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:07.106585 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-393042e1-4fa7-40f0-878b-b26091ed9e2a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:07.107915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-393042e1-4fa7-40f0-878b-b26091ed9e2a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:07.108681 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-393042e1-4fa7-40f0-878b-b26091ed9e2a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:07.134460 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-393042e1-4fa7-40f0-878b-b26091ed9e2a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:23:07.482387 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-393042e1-4fa7-40f0-878b-b26091ed9e2a tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 204 len: 0 microversion: 2.1 time: 0.389858 Apr 05 11:23:07.483038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 565/1099] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:23:07 2022] DELETE /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:23:07.491372 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5bcb287b-ba97-487c-b645-a0e65be2ff68 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:07.491947 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5bcb287b-ba97-487c-b645-a0e65be2ff68 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:07.498417 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5bcb287b-ba97-487c-b645-a0e65be2ff68 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:07.499117 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5bcb287b-ba97-487c-b645-a0e65be2ff68 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:07.499810 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5bcb287b-ba97-487c-b645-a0e65be2ff68 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:07.500303 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5bcb287b-ba97-487c-b645-a0e65be2ff68 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:07.631062 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5bcb287b-ba97-487c-b645-a0e65be2ff68 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:07.638276 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5bcb287b-ba97-487c-b645-a0e65be2ff68 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1506 microversion: 2.1 time: 0.150825 Apr 05 11:23:07.638894 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 535/1100] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:07 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:08.655644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dac78b25-cd09-4741-a648-8b18f747c5a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:08.656341 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dac78b25-cd09-4741-a648-8b18f747c5a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:08.662513 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dac78b25-cd09-4741-a648-8b18f747c5a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:08.662990 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dac78b25-cd09-4741-a648-8b18f747c5a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:08.663751 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dac78b25-cd09-4741-a648-8b18f747c5a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:08.664182 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dac78b25-cd09-4741-a648-8b18f747c5a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:08.799476 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-dac78b25-cd09-4741-a648-8b18f747c5a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:08.806834 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dac78b25-cd09-4741-a648-8b18f747c5a3 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1506 microversion: 2.1 time: 0.155376 Apr 05 11:23:08.807404 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 566/1101] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:08 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:09.058969 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-38c7e3a0-7474-4ee5-8729-88d6712a5e0a req-c7b95fc1-d4a9-457d-9ed5-b64526a31105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b89d15-5832-49f1-936c-f8219d65c62b", "name": "network-vif-deleted", "tag": "df7c1568-9880-4e21-856e-00b35d9664cd"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:09.068250 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-38c7e3a0-7474-4ee5-8729-88d6712a5e0a req-c7b95fc1-d4a9-457d-9ed5-b64526a31105 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:09.068716 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-38c7e3a0-7474-4ee5-8729-88d6712a5e0a req-c7b95fc1-d4a9-457d-9ed5-b64526a31105 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:09.080168 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-38c7e3a0-7474-4ee5-8729-88d6712a5e0a req-c7b95fc1-d4a9-457d-9ed5-b64526a31105 service nova] Creating event network-vif-deleted:df7c1568-9880-4e21-856e-00b35d9664cd for instance 31b89d15-5832-49f1-936c-f8219d65c62b on hv-cinder-81899 Apr 05 11:23:09.086334 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-38c7e3a0-7474-4ee5-8729-88d6712a5e0a req-c7b95fc1-d4a9-457d-9ed5-b64526a31105 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031307 Apr 05 11:23:09.087506 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 536/1102] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:09.148480 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dfd4e359-5daf-4704-a2e5-c16b68610927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f34b9c7-fe55-4a5b-a3ea-340688dcb054"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:09.149602 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dfd4e359-5daf-4704-a2e5-c16b68610927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:09.155577 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dfd4e359-5daf-4704-a2e5-c16b68610927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:09.156027 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dfd4e359-5daf-4704-a2e5-c16b68610927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:09.156792 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dfd4e359-5daf-4704-a2e5-c16b68610927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:09.157232 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dfd4e359-5daf-4704-a2e5-c16b68610927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:09.824346 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-faa7f7f0-1f13-45d1-97f5-d0dc944a2789 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:09.824951 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-faa7f7f0-1f13-45d1-97f5-d0dc944a2789 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:09.831121 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-faa7f7f0-1f13-45d1-97f5-d0dc944a2789 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:09.831572 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-faa7f7f0-1f13-45d1-97f5-d0dc944a2789 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:09.832340 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-faa7f7f0-1f13-45d1-97f5-d0dc944a2789 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:09.837740 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-faa7f7f0-1f13-45d1-97f5-d0dc944a2789 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:09.871268 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-faa7f7f0-1f13-45d1-97f5-d0dc944a2789 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:09.871716 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-faa7f7f0-1f13-45d1-97f5-d0dc944a2789 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:09.872163 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-faa7f7f0-1f13-45d1-97f5-d0dc944a2789 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lazy-loading 'fault' on Instance uuid 31b89d15-5832-49f1-936c-f8219d65c62b {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:23:09.914557 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-faa7f7f0-1f13-45d1-97f5-d0dc944a2789 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:09.921890 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-faa7f7f0-1f13-45d1-97f5-d0dc944a2789 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 200 len: 1311 microversion: 2.1 time: 0.101859 Apr 05 11:23:09.922661 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 537/1103] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:09 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:23:10.025425 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dfd4e359-5daf-4704-a2e5-c16b68610927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "POST /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.880753 Apr 05 11:23:10.026945 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 567/1104] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:23:09 2022] POST /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-volume_attachments => generated 194 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:10.944035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1ba269b5-d5d4-4d84-a3dc-f8426df25455 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:10.944641 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1ba269b5-d5d4-4d84-a3dc-f8426df25455 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: 31b89d15-5832-49f1-936c-f8219d65c62b] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:10.951941 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1ba269b5-d5d4-4d84-a3dc-f8426df25455 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:10.952392 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1ba269b5-d5d4-4d84-a3dc-f8426df25455 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:10.953177 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1ba269b5-d5d4-4d84-a3dc-f8426df25455 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:10.953602 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1ba269b5-d5d4-4d84-a3dc-f8426df25455 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:10.967259 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-1ba269b5-d5d4-4d84-a3dc-f8426df25455 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] HTTP exception thrown: Instance 31b89d15-5832-49f1-936c-f8219d65c62b could not be found. Apr 05 11:23:10.967836 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1ba269b5-d5d4-4d84-a3dc-f8426df25455 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Returning 404 to user: Instance 31b89d15-5832-49f1-936c-f8219d65c62b could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:23:10.968640 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1ba269b5-d5d4-4d84-a3dc-f8426df25455 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b" status: 404 len: 111 microversion: 2.1 time: 0.028704 Apr 05 11:23:10.969179 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 538/1105] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:10 2022] GET /compute/v2.1/servers/31b89d15-5832-49f1-936c-f8219d65c62b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:23:10.978163 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-aad0499f-08ed-404f-9a88-d84bef530b63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:10.978771 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-aad0499f-08ed-404f-9a88-d84bef530b63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:10.985770 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aad0499f-08ed-404f-9a88-d84bef530b63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:10.986250 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aad0499f-08ed-404f-9a88-d84bef530b63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:10.987040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aad0499f-08ed-404f-9a88-d84bef530b63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:10.987476 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aad0499f-08ed-404f-9a88-d84bef530b63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:11.012142 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-aad0499f-08ed-404f-9a88-d84bef530b63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:23:11.318892 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-aad0499f-08ed-404f-9a88-d84bef530b63 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 204 len: 0 microversion: 2.1 time: 0.345003 Apr 05 11:23:11.319553 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 568/1106] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:23:10 2022] DELETE /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:23:11.328516 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3eec5b6c-e4ba-45a9-817f-7ef1934faa23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:11.336025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3eec5b6c-e4ba-45a9-817f-7ef1934faa23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:11.336210 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3eec5b6c-e4ba-45a9-817f-7ef1934faa23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:11.336626 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3eec5b6c-e4ba-45a9-817f-7ef1934faa23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:11.337403 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3eec5b6c-e4ba-45a9-817f-7ef1934faa23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:11.337838 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3eec5b6c-e4ba-45a9-817f-7ef1934faa23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:11.355163 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9dfe5cd0-ceca-4cb7-a301-78432f7fc5dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:11.355745 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9dfe5cd0-ceca-4cb7-a301-78432f7fc5dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:11.361825 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9dfe5cd0-ceca-4cb7-a301-78432f7fc5dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:11.362277 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9dfe5cd0-ceca-4cb7-a301-78432f7fc5dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:11.363073 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9dfe5cd0-ceca-4cb7-a301-78432f7fc5dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:11.363505 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9dfe5cd0-ceca-4cb7-a301-78432f7fc5dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:11.386358 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9dfe5cd0-ceca-4cb7-a301-78432f7fc5dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/ips" status: 200 len: 152 microversion: 2.20 time: 0.035660 Apr 05 11:23:11.387936 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 569/1107] 10.222.0.39 () {60 vars in 1288 bytes} [Tue Apr 5 11:23:11 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 11:23:11.474104 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3eec5b6c-e4ba-45a9-817f-7ef1934faa23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:11.481625 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3eec5b6c-e4ba-45a9-817f-7ef1934faa23 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.157894 Apr 05 11:23:11.482187 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 539/1108] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:11 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:12.499329 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8ad91d13-f928-4d68-86dc-7dd8200fc57c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:12.499975 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8ad91d13-f928-4d68-86dc-7dd8200fc57c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:12.506172 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ad91d13-f928-4d68-86dc-7dd8200fc57c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:12.506624 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ad91d13-f928-4d68-86dc-7dd8200fc57c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:12.507393 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ad91d13-f928-4d68-86dc-7dd8200fc57c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:12.507832 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ad91d13-f928-4d68-86dc-7dd8200fc57c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:12.645536 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8ad91d13-f928-4d68-86dc-7dd8200fc57c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:12.653110 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8ad91d13-f928-4d68-86dc-7dd8200fc57c tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1520 microversion: 2.1 time: 0.158256 Apr 05 11:23:12.655883 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 570/1109] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:12 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:12.725400 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-9d313fbe-964b-4ecd-8432-b6d8dcdf9b6e req-18d0ea05-152d-489a-8f25-377f7f5985bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f4506a-1e74-4699-938c-1fe000c3d0e7", "name": "network-vif-deleted", "tag": "01522163-0d2a-4854-8bdc-d67d7aa1cd89"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:12.735379 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-9d313fbe-964b-4ecd-8432-b6d8dcdf9b6e req-18d0ea05-152d-489a-8f25-377f7f5985bd service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:12.736168 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-9d313fbe-964b-4ecd-8432-b6d8dcdf9b6e req-18d0ea05-152d-489a-8f25-377f7f5985bd service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:12.747797 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-9d313fbe-964b-4ecd-8432-b6d8dcdf9b6e req-18d0ea05-152d-489a-8f25-377f7f5985bd service nova] Creating event network-vif-deleted:01522163-0d2a-4854-8bdc-d67d7aa1cd89 for instance e8f4506a-1e74-4699-938c-1fe000c3d0e7 on hv-cinder-81899 Apr 05 11:23:12.753008 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-9d313fbe-964b-4ecd-8432-b6d8dcdf9b6e req-18d0ea05-152d-489a-8f25-377f7f5985bd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031252 Apr 05 11:23:12.753607 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 540/1110] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:13.671295 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2cd2a1d1-df26-4bad-8085-f7fc7098c111 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:13.671936 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2cd2a1d1-df26-4bad-8085-f7fc7098c111 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:13.679454 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cd2a1d1-df26-4bad-8085-f7fc7098c111 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:13.679907 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cd2a1d1-df26-4bad-8085-f7fc7098c111 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:13.680702 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cd2a1d1-df26-4bad-8085-f7fc7098c111 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:13.681141 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cd2a1d1-df26-4bad-8085-f7fc7098c111 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:13.714576 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cd2a1d1-df26-4bad-8085-f7fc7098c111 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:13.715688 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cd2a1d1-df26-4bad-8085-f7fc7098c111 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:13.716080 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-2cd2a1d1-df26-4bad-8085-f7fc7098c111 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lazy-loading 'fault' on Instance uuid e8f4506a-1e74-4699-938c-1fe000c3d0e7 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:23:13.759359 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2cd2a1d1-df26-4bad-8085-f7fc7098c111 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4fa0f1800044a5bb00641ed885841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf751cbfd21e463e83beea4d29713404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:13.767638 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2cd2a1d1-df26-4bad-8085-f7fc7098c111 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 200 len: 1311 microversion: 2.1 time: 0.100591 Apr 05 11:23:13.768218 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 571/1111] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:13 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:14.627354 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e1cd3233-8c54-497d-97b3-9e385e88d429 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:14.627969 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e1cd3233-8c54-497d-97b3-9e385e88d429 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:14.634042 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e1cd3233-8c54-497d-97b3-9e385e88d429 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:14.634507 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e1cd3233-8c54-497d-97b3-9e385e88d429 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:14.635284 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e1cd3233-8c54-497d-97b3-9e385e88d429 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:14.635724 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e1cd3233-8c54-497d-97b3-9e385e88d429 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:14.657576 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-e1cd3233-8c54-497d-97b3-9e385e88d429 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lazy-loading 'flavor' on Instance uuid 078668ec-0695-4717-bef7-1153cdc2dd14 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:23:14.785026 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-816198b4-04fd-4a8e-b2ec-bca9fa7c57d2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:14.785659 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-816198b4-04fd-4a8e-b2ec-bca9fa7c57d2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] [instance: e8f4506a-1e74-4699-938c-1fe000c3d0e7] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:14.792111 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-816198b4-04fd-4a8e-b2ec-bca9fa7c57d2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:14.792561 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-816198b4-04fd-4a8e-b2ec-bca9fa7c57d2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:14.793421 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-816198b4-04fd-4a8e-b2ec-bca9fa7c57d2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:14.793852 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-816198b4-04fd-4a8e-b2ec-bca9fa7c57d2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:14.807276 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-816198b4-04fd-4a8e-b2ec-bca9fa7c57d2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] HTTP exception thrown: Instance e8f4506a-1e74-4699-938c-1fe000c3d0e7 could not be found. Apr 05 11:23:14.807854 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-816198b4-04fd-4a8e-b2ec-bca9fa7c57d2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] Returning 404 to user: Instance e8f4506a-1e74-4699-938c-1fe000c3d0e7 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:23:14.808661 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-816198b4-04fd-4a8e-b2ec-bca9fa7c57d2 tempest-ServerRescueNegativeTestJSON-945489616 tempest-ServerRescueNegativeTestJSON-945489616-project] 10.222.0.39 "GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7" status: 404 len: 111 microversion: 2.1 time: 0.028113 Apr 05 11:23:14.809178 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 572/1112] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:14 2022] GET /compute/v2.1/servers/e8f4506a-1e74-4699-938c-1fe000c3d0e7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:23:15.271113 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e1cd3233-8c54-497d-97b3-9e385e88d429 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "POST /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/action" status: 202 len: 0 microversion: 2.20 time: 0.649015 Apr 05 11:23:15.272054 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 541/1113] 10.222.0.39 () {62 vars in 1318 bytes} [Tue Apr 5 11:23:14 2022] POST /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:23:15.281341 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-96d4c057-1864-4e64-81d3-733d5f3def59 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:15.282480 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-96d4c057-1864-4e64-81d3-733d5f3def59 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:15.292266 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-96d4c057-1864-4e64-81d3-733d5f3def59 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:15.292483 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-96d4c057-1864-4e64-81d3-733d5f3def59 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:15.293429 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-96d4c057-1864-4e64-81d3-733d5f3def59 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:15.294331 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-96d4c057-1864-4e64-81d3-733d5f3def59 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:15.448170 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-96d4c057-1864-4e64-81d3-733d5f3def59 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:15.457286 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-96d4c057-1864-4e64-81d3-733d5f3def59 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:15.458863 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-96d4c057-1864-4e64-81d3-733d5f3def59 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:15.460053 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-96d4c057-1864-4e64-81d3-733d5f3def59 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.183945 Apr 05 11:23:15.460628 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 573/1114] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:15 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:23:16.480365 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eaadca92-d34b-4790-ae8b-3b0541480d1d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:16.481310 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eaadca92-d34b-4790-ae8b-3b0541480d1d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:16.488840 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eaadca92-d34b-4790-ae8b-3b0541480d1d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:16.489241 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eaadca92-d34b-4790-ae8b-3b0541480d1d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:16.490010 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eaadca92-d34b-4790-ae8b-3b0541480d1d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:16.490442 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eaadca92-d34b-4790-ae8b-3b0541480d1d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:16.743421 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eaadca92-d34b-4790-ae8b-3b0541480d1d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:16.752964 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eaadca92-d34b-4790-ae8b-3b0541480d1d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:16.752964 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eaadca92-d34b-4790-ae8b-3b0541480d1d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:16.753861 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eaadca92-d34b-4790-ae8b-3b0541480d1d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.278565 Apr 05 11:23:16.754423 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 542/1115] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:16 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:17.773130 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-991090d8-92ab-4f3e-8500-0bd994d21fdd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:17.774321 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-991090d8-92ab-4f3e-8500-0bd994d21fdd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:17.782285 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-991090d8-92ab-4f3e-8500-0bd994d21fdd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:17.783273 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-991090d8-92ab-4f3e-8500-0bd994d21fdd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:17.783673 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-991090d8-92ab-4f3e-8500-0bd994d21fdd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:17.784114 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-991090d8-92ab-4f3e-8500-0bd994d21fdd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:17.928806 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-991090d8-92ab-4f3e-8500-0bd994d21fdd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:17.936698 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-991090d8-92ab-4f3e-8500-0bd994d21fdd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:17.938198 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-991090d8-92ab-4f3e-8500-0bd994d21fdd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:17.939378 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-991090d8-92ab-4f3e-8500-0bd994d21fdd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.170486 Apr 05 11:23:17.939937 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 574/1116] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:17 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:18.601602 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e94728c6-441c-4636-b7a7-5ce03b839ad3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f34b9c7-fe55-4a5b-a3ea-340688dcb054"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:18.602786 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e94728c6-441c-4636-b7a7-5ce03b839ad3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:18.610260 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e94728c6-441c-4636-b7a7-5ce03b839ad3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:18.610751 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e94728c6-441c-4636-b7a7-5ce03b839ad3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:18.611554 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e94728c6-441c-4636-b7a7-5ce03b839ad3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:18.611991 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e94728c6-441c-4636-b7a7-5ce03b839ad3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:18.704393 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-e94728c6-441c-4636-b7a7-5ce03b839ad3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Invalid volume: volume 0f34b9c7-fe55-4a5b-a3ea-340688dcb054 is already attached to instances: 1eb84f3b-18ce-4112-96a8-e6c729c759d2 Apr 05 11:23:18.705087 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e94728c6-441c-4636-b7a7-5ce03b839ad3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 400 to user: Invalid volume: volume 0f34b9c7-fe55-4a5b-a3ea-340688dcb054 is already attached to instances: 1eb84f3b-18ce-4112-96a8-e6c729c759d2 {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:23:18.706293 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e94728c6-441c-4636-b7a7-5ce03b839ad3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "POST /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109720 Apr 05 11:23:18.706975 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 543/1117] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:23:18 2022] POST /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:23:18.768282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d73b7a7d-9be7-49c1-a58a-4120c6a0e5db tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:18.768945 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d73b7a7d-9be7-49c1-a58a-4120c6a0e5db tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:18.782302 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d73b7a7d-9be7-49c1-a58a-4120c6a0e5db tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:18.782970 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d73b7a7d-9be7-49c1-a58a-4120c6a0e5db tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:18.783638 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d73b7a7d-9be7-49c1-a58a-4120c6a0e5db tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:18.784179 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d73b7a7d-9be7-49c1-a58a-4120c6a0e5db tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:18.879783 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-d73b7a7d-9be7-49c1-a58a-4120c6a0e5db tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lazy-loading 'services' on Instance uuid 1eb84f3b-18ce-4112-96a8-e6c729c759d2 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:23:18.957695 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-231c1fc7-7b38-4129-b9b3-afe4eeab31e7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:18.958311 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-231c1fc7-7b38-4129-b9b3-afe4eeab31e7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:18.965045 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-231c1fc7-7b38-4129-b9b3-afe4eeab31e7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:18.965557 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-231c1fc7-7b38-4129-b9b3-afe4eeab31e7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:18.966493 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-231c1fc7-7b38-4129-b9b3-afe4eeab31e7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:18.966965 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-231c1fc7-7b38-4129-b9b3-afe4eeab31e7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:19.108563 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-231c1fc7-7b38-4129-b9b3-afe4eeab31e7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:19.117323 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-231c1fc7-7b38-4129-b9b3-afe4eeab31e7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:19.118875 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-231c1fc7-7b38-4129-b9b3-afe4eeab31e7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:19.120019 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-231c1fc7-7b38-4129-b9b3-afe4eeab31e7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.166462 Apr 05 11:23:19.120733 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 544/1118] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:18 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:23:19.197193 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d73b7a7d-9be7-49c1-a58a-4120c6a0e5db tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-volume_attachments/0f34b9c7-fe55-4a5b-a3ea-340688dcb054" status: 202 len: 0 microversion: 2.1 time: 0.425844 Apr 05 11:23:19.197193 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 575/1119] 10.222.0.39 () {58 vars in 1415 bytes} [Tue Apr 5 11:23:18 2022] DELETE /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-volume_attachments/0f34b9c7-fe55-4a5b-a3ea-340688dcb054 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:23:19.199498 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-46c06f9b-8ebe-4f7e-92be-288540e363e4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:19.201103 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-46c06f9b-8ebe-4f7e-92be-288540e363e4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:19.207154 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-46c06f9b-8ebe-4f7e-92be-288540e363e4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:19.207605 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-46c06f9b-8ebe-4f7e-92be-288540e363e4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:19.208369 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-46c06f9b-8ebe-4f7e-92be-288540e363e4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:19.208810 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-46c06f9b-8ebe-4f7e-92be-288540e363e4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:19.238370 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-46c06f9b-8ebe-4f7e-92be-288540e363e4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042798 Apr 05 11:23:19.243022 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 545/1120] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:23:19 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:20.138518 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7c10ba0b-82cc-4719-a3b2-000e4afa2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:20.139251 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7c10ba0b-82cc-4719-a3b2-000e4afa2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:20.145831 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c10ba0b-82cc-4719-a3b2-000e4afa2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:20.146280 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c10ba0b-82cc-4719-a3b2-000e4afa2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:20.147094 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c10ba0b-82cc-4719-a3b2-000e4afa2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:20.147535 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c10ba0b-82cc-4719-a3b2-000e4afa2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:20.252692 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f2d9230d-fb67-4218-b315-80341f3dfa59 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:20.253846 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f2d9230d-fb67-4218-b315-80341f3dfa59 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:20.260198 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2d9230d-fb67-4218-b315-80341f3dfa59 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:20.260594 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2d9230d-fb67-4218-b315-80341f3dfa59 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:20.261403 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2d9230d-fb67-4218-b315-80341f3dfa59 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:20.261837 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2d9230d-fb67-4218-b315-80341f3dfa59 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:20.295353 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c10ba0b-82cc-4719-a3b2-000e4afa2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:20.304789 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f2d9230d-fb67-4218-b315-80341f3dfa59 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056073 Apr 05 11:23:20.305373 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 546/1121] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:23:20 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:20.306925 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c10ba0b-82cc-4719-a3b2-000e4afa2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:20.308708 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c10ba0b-82cc-4719-a3b2-000e4afa2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:20.309973 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7c10ba0b-82cc-4719-a3b2-000e4afa2875 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.176281 Apr 05 11:23:20.310528 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 576/1122] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:20 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:21.068735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-db9c251c-2548-416c-94cf-24fa6cd4b4c7 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Action: 'create', calling method: .version_select at 0x7fec0c08cf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1532264002"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:21.317325 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-58c3f901-5b23-404a-a9e0-fd6a3880a6df tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:21.318321 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-58c3f901-5b23-404a-a9e0-fd6a3880a6df tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:21.324828 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58c3f901-5b23-404a-a9e0-fd6a3880a6df tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:21.325274 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58c3f901-5b23-404a-a9e0-fd6a3880a6df tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:21.326149 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58c3f901-5b23-404a-a9e0-fd6a3880a6df tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:21.326586 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58c3f901-5b23-404a-a9e0-fd6a3880a6df tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:21.354498 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-58c3f901-5b23-404a-a9e0-fd6a3880a6df tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041246 Apr 05 11:23:21.355076 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 577/1123] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:23:21 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 05 11:23:21.360285 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b55e2506-6e18-4c46-b8e2-29096bc325b0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:21.360928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b55e2506-6e18-4c46-b8e2-29096bc325b0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:21.368712 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b55e2506-6e18-4c46-b8e2-29096bc325b0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:21.368712 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b55e2506-6e18-4c46-b8e2-29096bc325b0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:21.368712 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b55e2506-6e18-4c46-b8e2-29096bc325b0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:21.368712 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b55e2506-6e18-4c46-b8e2-29096bc325b0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:21.502558 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b55e2506-6e18-4c46-b8e2-29096bc325b0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:21.510466 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b55e2506-6e18-4c46-b8e2-29096bc325b0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:21.511995 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b55e2506-6e18-4c46-b8e2-29096bc325b0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:21.513272 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b55e2506-6e18-4c46-b8e2-29096bc325b0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.157157 Apr 05 11:23:21.513827 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 578/1124] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:21 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:21.518196 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3896277a-80d0-4ca5-8165-bc0cec6115e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:21.518704 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3896277a-80d0-4ca5-8165-bc0cec6115e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:21.524378 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3896277a-80d0-4ca5-8165-bc0cec6115e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:21.524873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3896277a-80d0-4ca5-8165-bc0cec6115e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:21.525698 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3896277a-80d0-4ca5-8165-bc0cec6115e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:21.526134 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3896277a-80d0-4ca5-8165-bc0cec6115e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:21.550826 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3896277a-80d0-4ca5-8165-bc0cec6115e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:23:21.933527 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-db9c251c-2548-416c-94cf-24fa6cd4b4c7 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.981916 Apr 05 11:23:21.934163 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 547/1125] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Apr 5 11:23:20 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 984 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Apr 05 11:23:21.944490 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-734c5394-ee7a-4ebb-8c88-4fa2912df311 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec0c0aa040>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:21.959788 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3896277a-80d0-4ca5-8165-bc0cec6115e8 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 204 len: 0 microversion: 2.1 time: 0.444616 Apr 05 11:23:21.960391 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 579/1126] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:23:21 2022] DELETE /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:23:21.969864 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-eab7e7fc-5605-40fe-a67a-df71678be4bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:21.970562 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-eab7e7fc-5605-40fe-a67a-df71678be4bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:21.976777 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eab7e7fc-5605-40fe-a67a-df71678be4bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:21.977225 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eab7e7fc-5605-40fe-a67a-df71678be4bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:21.978113 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eab7e7fc-5605-40fe-a67a-df71678be4bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:21.978483 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eab7e7fc-5605-40fe-a67a-df71678be4bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:21.992429 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-734c5394-ee7a-4ebb-8c88-4fa2912df311 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a" status: 200 len: 345 microversion: 2.1 time: 0.051483 Apr 05 11:23:21.997401 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 548/1127] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:23:21 2022] GET /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:23:22.117407 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-eab7e7fc-5605-40fe-a67a-df71678be4bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:22.125375 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-eab7e7fc-5605-40fe-a67a-df71678be4bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1682 microversion: 2.1 time: 0.160388 Apr 05 11:23:22.125957 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 580/1128] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:21 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:23:22.532778 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eb7735fa-89b8-4362-9250-97ab04fd6e25 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:22.533385 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eb7735fa-89b8-4362-9250-97ab04fd6e25 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:22.540165 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb7735fa-89b8-4362-9250-97ab04fd6e25 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:22.540669 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb7735fa-89b8-4362-9250-97ab04fd6e25 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:22.541388 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb7735fa-89b8-4362-9250-97ab04fd6e25 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:22.541819 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb7735fa-89b8-4362-9250-97ab04fd6e25 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:22.672930 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eb7735fa-89b8-4362-9250-97ab04fd6e25 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:22.680593 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eb7735fa-89b8-4362-9250-97ab04fd6e25 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:22.682115 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eb7735fa-89b8-4362-9250-97ab04fd6e25 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:22.683308 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eb7735fa-89b8-4362-9250-97ab04fd6e25 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.154900 Apr 05 11:23:22.683865 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 549/1129] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:22 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:23.005106 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-eb1cc68d-1a0b-486e-b251-83a03992ffcc tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec10820310>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:23.055097 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-eb1cc68d-1a0b-486e-b251-83a03992ffcc tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a" status: 200 len: 346 microversion: 2.1 time: 0.053761 Apr 05 11:23:23.055667 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 581/1130] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:23:22 2022] GET /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:23.066943 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-789676d9-fa27-4435-9800-b91a6eb5cfce tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Action: 'create', calling method: .version_select at 0x7fec0c120b80>, body: {"snapshot": {"volume_id": "daa35afa-dc5a-4569-b6fa-eaafec4b5a5a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1625590649"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:23.142764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-da2c5cc1-7af2-498a-9502-fb66e7f206b0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:23.144586 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-da2c5cc1-7af2-498a-9502-fb66e7f206b0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:23.149394 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-da2c5cc1-7af2-498a-9502-fb66e7f206b0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:23.149884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-da2c5cc1-7af2-498a-9502-fb66e7f206b0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:23.150681 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-da2c5cc1-7af2-498a-9502-fb66e7f206b0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:23.151123 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-da2c5cc1-7af2-498a-9502-fb66e7f206b0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:23.381395 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-da2c5cc1-7af2-498a-9502-fb66e7f206b0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:23.388795 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-da2c5cc1-7af2-498a-9502-fb66e7f206b0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1682 microversion: 2.1 time: 0.250049 Apr 05 11:23:23.389878 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 582/1131] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:23 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1682 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:23:23.702977 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f83ede8c-7edf-47f6-bbd7-a0d150cd707b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:23.706158 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f83ede8c-7edf-47f6-bbd7-a0d150cd707b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:23.706296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-789676d9-fa27-4435-9800-b91a6eb5cfce tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.640862 Apr 05 11:23:23.706296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 550/1132] 10.222.0.39 () {60 vars in 1161 bytes} [Tue Apr 5 11:23:23 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:23:23.709879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f83ede8c-7edf-47f6-bbd7-a0d150cd707b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:23.710410 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f83ede8c-7edf-47f6-bbd7-a0d150cd707b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:23.711875 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f83ede8c-7edf-47f6-bbd7-a0d150cd707b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:23.711875 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f83ede8c-7edf-47f6-bbd7-a0d150cd707b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:23.714076 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7946f944-cf7e-4bad-ab3b-807d906f0423 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec0c0ce4c0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:23.743942 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7946f944-cf7e-4bad-ab3b-807d906f0423 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612" status: 200 len: 287 microversion: 2.1 time: 0.033584 Apr 05 11:23:23.744844 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 551/1133] 10.222.0.39 () {58 vars in 1250 bytes} [Tue Apr 5 11:23:23 2022] GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:23:23.766140 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-68a49560-1f82-40d2-8062-c9e3cae9679d tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec0c05ad30>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:23.796548 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-68a49560-1f82-40d2-8062-c9e3cae9679d tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034829 Apr 05 11:23:23.799099 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 552/1134] 10.222.0.39 () {58 vars in 1139 bytes} [Tue Apr 5 11:23:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:23:23.806398 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b9ac2bca-6834-48d9-b5a3-87356431c591 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec06fe7c10>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:23.839962 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b9ac2bca-6834-48d9-b5a3-87356431c591 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612" status: 200 len: 287 microversion: 2.1 time: 0.037162 Apr 05 11:23:23.840549 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 553/1135] 10.222.0.39 () {58 vars in 1250 bytes} [Tue Apr 5 11:23:23 2022] GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:23:23.870701 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f83ede8c-7edf-47f6-bbd7-a0d150cd707b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:23.879389 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f83ede8c-7edf-47f6-bbd7-a0d150cd707b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:23.883980 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f83ede8c-7edf-47f6-bbd7-a0d150cd707b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:23.883980 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f83ede8c-7edf-47f6-bbd7-a0d150cd707b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.183884 Apr 05 11:23:23.883980 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 583/1136] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:23 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:23:24.407805 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-850f923e-d2f7-42cc-877c-5e6582f03e60 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:24.408407 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-850f923e-d2f7-42cc-877c-5e6582f03e60 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:24.414686 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-850f923e-d2f7-42cc-877c-5e6582f03e60 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:24.415142 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-850f923e-d2f7-42cc-877c-5e6582f03e60 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:24.415934 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-850f923e-d2f7-42cc-877c-5e6582f03e60 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:24.416370 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-850f923e-d2f7-42cc-877c-5e6582f03e60 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:24.792447 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-850f923e-d2f7-42cc-877c-5e6582f03e60 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:24.800347 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-850f923e-d2f7-42cc-877c-5e6582f03e60 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1682 microversion: 2.1 time: 0.397073 Apr 05 11:23:24.800970 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 554/1137] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:24 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1682 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:24.851089 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-92b7388d-8495-4454-8f5a-069eab1c31dc tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec108cf940>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:24.880233 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-92b7388d-8495-4454-8f5a-069eab1c31dc tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612" status: 200 len: 287 microversion: 2.1 time: 0.032859 Apr 05 11:23:24.880822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 584/1138] 10.222.0.39 () {58 vars in 1250 bytes} [Tue Apr 5 11:23:24 2022] GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:24.901019 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-963925af-aa77-4e73-9f37-ce6c984bc7f5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:24.901723 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-963925af-aa77-4e73-9f37-ce6c984bc7f5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:24.908583 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-963925af-aa77-4e73-9f37-ce6c984bc7f5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:24.908978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-963925af-aa77-4e73-9f37-ce6c984bc7f5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:24.909905 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-963925af-aa77-4e73-9f37-ce6c984bc7f5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:24.910373 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-963925af-aa77-4e73-9f37-ce6c984bc7f5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:25.159645 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-963925af-aa77-4e73-9f37-ce6c984bc7f5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:25.167623 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-963925af-aa77-4e73-9f37-ce6c984bc7f5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:25.169146 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-963925af-aa77-4e73-9f37-ce6c984bc7f5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:25.170309 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-963925af-aa77-4e73-9f37-ce6c984bc7f5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.273293 Apr 05 11:23:25.172038 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 555/1139] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:24 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:25.319141 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-fd95601f-3369-49d4-a37f-e18c1219565d req-a9a873b8-697d-4493-8e2b-82f5463d15b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb84f3b-18ce-4112-96a8-e6c729c759d2", "name": "network-vif-deleted", "tag": "ff329987-a622-46de-9587-bacbc941bd71"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:25.327608 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-fd95601f-3369-49d4-a37f-e18c1219565d req-a9a873b8-697d-4493-8e2b-82f5463d15b0 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:25.328271 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-fd95601f-3369-49d4-a37f-e18c1219565d req-a9a873b8-697d-4493-8e2b-82f5463d15b0 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:25.340153 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-fd95601f-3369-49d4-a37f-e18c1219565d req-a9a873b8-697d-4493-8e2b-82f5463d15b0 service nova] Creating event network-vif-deleted:ff329987-a622-46de-9587-bacbc941bd71 for instance 1eb84f3b-18ce-4112-96a8-e6c729c759d2 on hv-cinder-81899 Apr 05 11:23:25.346085 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-fd95601f-3369-49d4-a37f-e18c1219565d req-a9a873b8-697d-4493-8e2b-82f5463d15b0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030740 Apr 05 11:23:25.346803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 585/1140] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:25.817379 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3f923951-4ac4-4b0f-ae01-4e2dbe9f1c04 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:25.818014 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3f923951-4ac4-4b0f-ae01-4e2dbe9f1c04 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:25.824244 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3f923951-4ac4-4b0f-ae01-4e2dbe9f1c04 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:25.824691 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3f923951-4ac4-4b0f-ae01-4e2dbe9f1c04 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:25.825453 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3f923951-4ac4-4b0f-ae01-4e2dbe9f1c04 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:25.825888 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3f923951-4ac4-4b0f-ae01-4e2dbe9f1c04 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:25.887464 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3f923951-4ac4-4b0f-ae01-4e2dbe9f1c04 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:25.892190 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5de05f7a-6fc2-439a-aae0-ac8959508e72 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec10893f70>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:25.895855 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3f923951-4ac4-4b0f-ae01-4e2dbe9f1c04 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1614 microversion: 2.1 time: 0.082076 Apr 05 11:23:25.905337 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 556/1141] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:25 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:25.921526 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5de05f7a-6fc2-439a-aae0-ac8959508e72 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612" status: 200 len: 287 microversion: 2.1 time: 0.034086 Apr 05 11:23:25.922108 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 586/1142] 10.222.0.39 () {58 vars in 1250 bytes} [Tue Apr 5 11:23:25 2022] GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:23:26.189841 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e5771370-45cb-423b-8cb4-7b553e7e80a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:26.190566 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e5771370-45cb-423b-8cb4-7b553e7e80a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:26.196818 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e5771370-45cb-423b-8cb4-7b553e7e80a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:26.197278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e5771370-45cb-423b-8cb4-7b553e7e80a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:26.198060 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e5771370-45cb-423b-8cb4-7b553e7e80a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:26.198499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e5771370-45cb-423b-8cb4-7b553e7e80a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:26.334860 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e5771370-45cb-423b-8cb4-7b553e7e80a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:26.342703 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e5771370-45cb-423b-8cb4-7b553e7e80a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:26.344216 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e5771370-45cb-423b-8cb4-7b553e7e80a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:26.345376 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e5771370-45cb-423b-8cb4-7b553e7e80a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.160029 Apr 05 11:23:26.345929 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 557/1143] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:26 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:26.912976 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-125a2883-b7cc-4be9-9393-b2e27000f6ca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:26.913808 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-125a2883-b7cc-4be9-9393-b2e27000f6ca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:26.920427 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-125a2883-b7cc-4be9-9393-b2e27000f6ca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:26.921508 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-125a2883-b7cc-4be9-9393-b2e27000f6ca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:26.922274 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-125a2883-b7cc-4be9-9393-b2e27000f6ca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:26.922735 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-125a2883-b7cc-4be9-9393-b2e27000f6ca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:26.933135 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4fb9b33a-8f15-44f5-8260-751a27746836 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec0c120940>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:26.962737 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4fb9b33a-8f15-44f5-8260-751a27746836 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612" status: 200 len: 287 microversion: 2.1 time: 0.033294 Apr 05 11:23:26.963319 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 558/1144] 10.222.0.39 () {58 vars in 1250 bytes} [Tue Apr 5 11:23:26 2022] GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:23:26.982698 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-125a2883-b7cc-4be9-9393-b2e27000f6ca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:26.990992 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-125a2883-b7cc-4be9-9393-b2e27000f6ca tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1614 microversion: 2.1 time: 0.082439 Apr 05 11:23:26.991550 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 587/1145] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:26 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:27.364427 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c6bf6e15-43d8-481d-b630-0f7bba098913 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:27.365062 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c6bf6e15-43d8-481d-b630-0f7bba098913 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:27.371037 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6bf6e15-43d8-481d-b630-0f7bba098913 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:27.371485 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6bf6e15-43d8-481d-b630-0f7bba098913 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:27.374558 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6bf6e15-43d8-481d-b630-0f7bba098913 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:27.374558 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6bf6e15-43d8-481d-b630-0f7bba098913 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:27.504467 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c6bf6e15-43d8-481d-b630-0f7bba098913 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:27.512228 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c6bf6e15-43d8-481d-b630-0f7bba098913 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:27.513852 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c6bf6e15-43d8-481d-b630-0f7bba098913 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:27.514885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c6bf6e15-43d8-481d-b630-0f7bba098913 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.154526 Apr 05 11:23:27.515496 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 559/1146] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:27 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:23:27.974572 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fb452cf6-fb61-4c28-bff8-90f0dc2e31fa tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec10888700>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:28.008584 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6e7fe260-691f-4f13-a2c8-26577bc1ac86 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:28.011434 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6e7fe260-691f-4f13-a2c8-26577bc1ac86 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:28.016445 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6e7fe260-691f-4f13-a2c8-26577bc1ac86 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:28.016883 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6e7fe260-691f-4f13-a2c8-26577bc1ac86 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:28.017665 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6e7fe260-691f-4f13-a2c8-26577bc1ac86 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:28.018155 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6e7fe260-691f-4f13-a2c8-26577bc1ac86 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:28.025876 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fb452cf6-fb61-4c28-bff8-90f0dc2e31fa tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612" status: 200 len: 287 microversion: 2.1 time: 0.055072 Apr 05 11:23:28.030337 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 588/1147] 10.222.0.39 () {58 vars in 1250 bytes} [Tue Apr 5 11:23:27 2022] GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:28.108469 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6e7fe260-691f-4f13-a2c8-26577bc1ac86 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:28.116446 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6e7fe260-691f-4f13-a2c8-26577bc1ac86 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 200 len: 1614 microversion: 2.1 time: 0.111828 Apr 05 11:23:28.117029 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 560/1148] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:28 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 1614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:28.533564 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-110d3e45-b53d-4fbd-a239-fa1532497920 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:28.534086 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-110d3e45-b53d-4fbd-a239-fa1532497920 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:28.540418 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-110d3e45-b53d-4fbd-a239-fa1532497920 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:28.540867 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-110d3e45-b53d-4fbd-a239-fa1532497920 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:28.541631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-110d3e45-b53d-4fbd-a239-fa1532497920 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:28.542067 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-110d3e45-b53d-4fbd-a239-fa1532497920 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:28.673751 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-110d3e45-b53d-4fbd-a239-fa1532497920 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:28.681620 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-110d3e45-b53d-4fbd-a239-fa1532497920 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:28.683198 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-110d3e45-b53d-4fbd-a239-fa1532497920 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:28.684346 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-110d3e45-b53d-4fbd-a239-fa1532497920 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.154871 Apr 05 11:23:28.684900 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 589/1149] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:28 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:29.037742 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d94af395-20c2-4e93-b081-159e8b08b92b tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec0c2d8700>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:29.067376 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d94af395-20c2-4e93-b081-159e8b08b92b tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612" status: 200 len: 288 microversion: 2.1 time: 0.033461 Apr 05 11:23:29.067954 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 561/1150] 10.222.0.39 () {58 vars in 1250 bytes} [Tue Apr 5 11:23:29 2022] GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:29.077866 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5dbfa900-4d4c-4a36-9b17-15754eaf89fc tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec0c0fa9d0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:29.133241 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-53fc3f3f-4cb1-4393-b275-547d9bafcb77 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:29.133853 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-53fc3f3f-4cb1-4393-b275-547d9bafcb77 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:29.139993 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53fc3f3f-4cb1-4393-b275-547d9bafcb77 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:29.149803 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53fc3f3f-4cb1-4393-b275-547d9bafcb77 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:29.149803 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53fc3f3f-4cb1-4393-b275-547d9bafcb77 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:29.149803 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53fc3f3f-4cb1-4393-b275-547d9bafcb77 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:29.154499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-53fc3f3f-4cb1-4393-b275-547d9bafcb77 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Instance 1eb84f3b-18ce-4112-96a8-e6c729c759d2 could not be found. Apr 05 11:23:29.155117 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-53fc3f3f-4cb1-4393-b275-547d9bafcb77 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 404 to user: Instance 1eb84f3b-18ce-4112-96a8-e6c729c759d2 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:23:29.156420 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-53fc3f3f-4cb1-4393-b275-547d9bafcb77 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 404 len: 111 microversion: 2.1 time: 0.026608 Apr 05 11:23:29.156956 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 562/1151] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:29 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:23:29.164974 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f8f3c52d-388f-49fd-b170-ed98fb88cf76 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '.version_select at 0x7fec0c2d8e50>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:29.244464 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5dbfa900-4d4c-4a36-9b17-15754eaf89fc tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612" status: 202 len: 0 microversion: 2.1 time: 0.170307 Apr 05 11:23:29.245058 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 590/1152] 10.222.0.39 () {58 vars in 1253 bytes} [Tue Apr 5 11:23:29 2022] DELETE /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:23:29.253368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8a14a07b-5bfc-43fe-9756-bdaa2dacb352 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec0c0d1940>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:29.279210 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f8f3c52d-388f-49fd-b170-ed98fb88cf76 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-523744002" status: 202 len: 0 microversion: 2.1 time: 0.117730 Apr 05 11:23:29.279792 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 563/1153] 10.222.0.39 () {58 vars in 1217 bytes} [Tue Apr 5 11:23:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-523744002 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:23:29.283681 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8a14a07b-5bfc-43fe-9756-bdaa2dacb352 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612" status: 200 len: 287 microversion: 2.1 time: 0.034088 Apr 05 11:23:29.284760 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 591/1154] 10.222.0.39 () {58 vars in 1250 bytes} [Tue Apr 5 11:23:29 2022] GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:23:29.702411 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a8c42165-bbb1-4cc2-9718-498fa47c89e3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:29.703666 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a8c42165-bbb1-4cc2-9718-498fa47c89e3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:29.709480 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a8c42165-bbb1-4cc2-9718-498fa47c89e3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:29.709937 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a8c42165-bbb1-4cc2-9718-498fa47c89e3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:29.710750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a8c42165-bbb1-4cc2-9718-498fa47c89e3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:29.711174 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a8c42165-bbb1-4cc2-9718-498fa47c89e3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:29.853820 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a8c42165-bbb1-4cc2-9718-498fa47c89e3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:29.854444 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a8c42165-bbb1-4cc2-9718-498fa47c89e3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:29.856031 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a8c42165-bbb1-4cc2-9718-498fa47c89e3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:29.857237 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a8c42165-bbb1-4cc2-9718-498fa47c89e3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.158756 Apr 05 11:23:29.857800 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 564/1155] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:29 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:30.086801 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-37c36135-8e28-4715-96cf-13a54138c96a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Action: 'create', calling method: .version_select at 0x7fec0c0d15e0>, body: {"keypair": {"name": "tempest-keypair-109001977"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:30.102072 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-37c36135-8e28-4715-96cf-13a54138c96a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:23:30.105873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-37c36135-8e28-4715-96cf-13a54138c96a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for user 08f7e9cf075d43b39802bbdc58cd604f and project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:23:30.299186 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ca286d8e-0ef2-4fb4-93c4-a1bc63841551 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec0c05a5e0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:30.326458 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-ca286d8e-0ef2-4fb4-93c4-a1bc63841551 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] HTTP exception thrown: Snapshot 28aa112b-1553-44da-bd1c-6411b8671612 could not be found. Apr 05 11:23:30.326458 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ca286d8e-0ef2-4fb4-93c4-a1bc63841551 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Returning 404 to user: Snapshot 28aa112b-1553-44da-bd1c-6411b8671612 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:23:30.326458 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ca286d8e-0ef2-4fb4-93c4-a1bc63841551 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612" status: 404 len: 111 microversion: 2.1 time: 0.029443 Apr 05 11:23:30.326458 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 565/1156] 10.222.0.39 () {58 vars in 1250 bytes} [Tue Apr 5 11:23:30 2022] GET /compute/v2.1/os-snapshots/28aa112b-1553-44da-bd1c-6411b8671612 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:23:30.333407 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-98a87885-9b43-4c2a-b600-f8a09da0e238 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec06fe79d0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:30.356669 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-37c36135-8e28-4715-96cf-13a54138c96a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:23:30.360610 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-37c36135-8e28-4715-96cf-13a54138c96a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for user 08f7e9cf075d43b39802bbdc58cd604f and project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:23:30.373405 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-37c36135-8e28-4715-96cf-13a54138c96a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.290559 Apr 05 11:23:30.374000 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 592/1157] 10.222.0.39 () {60 vars in 1157 bytes} [Tue Apr 5 11:23:30 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:30.631057 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-98a87885-9b43-4c2a-b600-f8a09da0e238 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a" status: 202 len: 0 microversion: 2.1 time: 0.300999 Apr 05 11:23:30.631831 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 566/1158] 10.222.0.39 () {58 vars in 1247 bytes} [Tue Apr 5 11:23:30 2022] DELETE /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:23:30.640841 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3d7817ee-5b4d-4669-afff-d721b432df90 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec0c0fa280>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:30.686674 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3d7817ee-5b4d-4669-afff-d721b432df90 tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a" status: 200 len: 345 microversion: 2.1 time: 0.050491 Apr 05 11:23:30.687759 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 593/1159] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:23:30 2022] GET /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:30.876310 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0ae38e61-4654-4ebd-8296-cf59256ddde5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:30.876851 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0ae38e61-4654-4ebd-8296-cf59256ddde5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:30.883208 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ae38e61-4654-4ebd-8296-cf59256ddde5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:30.883661 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ae38e61-4654-4ebd-8296-cf59256ddde5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:30.884458 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ae38e61-4654-4ebd-8296-cf59256ddde5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:30.885667 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ae38e61-4654-4ebd-8296-cf59256ddde5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:31.018392 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0ae38e61-4654-4ebd-8296-cf59256ddde5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:31.026877 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0ae38e61-4654-4ebd-8296-cf59256ddde5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:31.033671 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0ae38e61-4654-4ebd-8296-cf59256ddde5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:31.033671 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0ae38e61-4654-4ebd-8296-cf59256ddde5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.157886 Apr 05 11:23:31.033671 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 567/1160] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:30 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:31.700662 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6d2a8a97-639c-4209-83c9-ec9d63c87dab tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec10888af0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:31.727661 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-6d2a8a97-639c-4209-83c9-ec9d63c87dab tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] HTTP exception thrown: Volume daa35afa-dc5a-4569-b6fa-eaafec4b5a5a could not be found. Apr 05 11:23:31.728290 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6d2a8a97-639c-4209-83c9-ec9d63c87dab tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Returning 404 to user: Volume daa35afa-dc5a-4569-b6fa-eaafec4b5a5a could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:23:31.729106 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6d2a8a97-639c-4209-83c9-ec9d63c87dab tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a" status: 404 len: 109 microversion: 2.1 time: 0.033037 Apr 05 11:23:31.729698 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 594/1161] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:23:31 2022] GET /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:23:31.744075 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-41f4c101-09ae-4a27-85a7-d72db10c10bb tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec0c257c10>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:31.772792 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-41f4c101-09ae-4a27-85a7-d72db10c10bb tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] HTTP exception thrown: Volume daa35afa-dc5a-4569-b6fa-eaafec4b5a5a could not be found. Apr 05 11:23:31.773394 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-41f4c101-09ae-4a27-85a7-d72db10c10bb tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Returning 404 to user: Volume daa35afa-dc5a-4569-b6fa-eaafec4b5a5a could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:23:31.774231 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-41f4c101-09ae-4a27-85a7-d72db10c10bb tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a" status: 404 len: 109 microversion: 2.1 time: 0.034286 Apr 05 11:23:31.774818 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 568/1162] 10.222.0.39 () {58 vars in 1247 bytes} [Tue Apr 5 11:23:31 2022] DELETE /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:23:31.784030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3b6b57f5-47a9-4144-9b34-06cd50d5b1fa tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Calling method '.version_select at 0x7fec0c148820>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:31.809899 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-3b6b57f5-47a9-4144-9b34-06cd50d5b1fa tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] HTTP exception thrown: Volume daa35afa-dc5a-4569-b6fa-eaafec4b5a5a could not be found. Apr 05 11:23:31.810496 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3b6b57f5-47a9-4144-9b34-06cd50d5b1fa tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] Returning 404 to user: Volume daa35afa-dc5a-4569-b6fa-eaafec4b5a5a could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:23:31.811363 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3b6b57f5-47a9-4144-9b34-06cd50d5b1fa tempest-VolumesSnapshotsTestJSON-1338336397 tempest-VolumesSnapshotsTestJSON-1338336397-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a" status: 404 len: 109 microversion: 2.1 time: 0.032575 Apr 05 11:23:31.814639 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 595/1163] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:23:31 2022] GET /compute/v2.1/os-volumes/daa35afa-dc5a-4569-b6fa-eaafec4b5a5a => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:23:32.047978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-483db88c-e304-43f2-9e78-26e42ea8792f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:32.048832 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-483db88c-e304-43f2-9e78-26e42ea8792f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:32.055857 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-483db88c-e304-43f2-9e78-26e42ea8792f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:32.056357 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-483db88c-e304-43f2-9e78-26e42ea8792f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:32.057129 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-483db88c-e304-43f2-9e78-26e42ea8792f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:32.057567 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-483db88c-e304-43f2-9e78-26e42ea8792f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:32.159745 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6d203786-e70c-4042-b091-7db92aa0b0b4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:32.160270 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6d203786-e70c-4042-b091-7db92aa0b0b4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:32.166315 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d203786-e70c-4042-b091-7db92aa0b0b4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:32.166806 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d203786-e70c-4042-b091-7db92aa0b0b4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:32.167571 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d203786-e70c-4042-b091-7db92aa0b0b4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:32.167997 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d203786-e70c-4042-b091-7db92aa0b0b4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:32.192234 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6d203786-e70c-4042-b091-7db92aa0b0b4 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/ips" status: 200 len: 146 microversion: 2.1 time: 0.036247 Apr 05 11:23:32.198700 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 596/1164] 10.222.0.39 () {58 vars in 1247 bytes} [Tue Apr 5 11:23:32 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:23:32.459694 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-483db88c-e304-43f2-9e78-26e42ea8792f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:32.467678 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-483db88c-e304-43f2-9e78-26e42ea8792f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:32.469127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-483db88c-e304-43f2-9e78-26e42ea8792f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:32.470277 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-483db88c-e304-43f2-9e78-26e42ea8792f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.426593 Apr 05 11:23:32.470865 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 569/1165] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:32 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:33.472580 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1445578362", "imageRef": "67ce9639-3913-4323-9879-af93f04880cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61947bc0-bf95-4d84-a95a-a866833cbe78"}], "security_groups": [{"name": "tempest-securitygroup--2041816655"}], "key_name": "tempest-keypair-109001977", "user_data": "}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:33.489215 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2cb97176-1a73-454b-928a-8785202bb5a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:33.490127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2cb97176-1a73-454b-928a-8785202bb5a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:33.497007 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2cb97176-1a73-454b-928a-8785202bb5a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:33.497687 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2cb97176-1a73-454b-928a-8785202bb5a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:33.498710 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2cb97176-1a73-454b-928a-8785202bb5a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:33.499158 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2cb97176-1a73-454b-928a-8785202bb5a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:33.578732 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] validate_networks() for [('61947bc0-bf95-4d84-a95a-a866833cbe78', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:23:33.639732 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2cb97176-1a73-454b-928a-8785202bb5a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:33.648299 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2cb97176-1a73-454b-928a-8785202bb5a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:33.649813 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2cb97176-1a73-454b-928a-8785202bb5a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:33.650996 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2cb97176-1a73-454b-928a-8785202bb5a9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.166461 Apr 05 11:23:33.651562 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 570/1166] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:33 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:23:33.959935 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:23:33.960364 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:23:33.960899 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:23:33.961316 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:23:33.961754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:23:33.970375 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:33.970860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:33.979715 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:33.979715 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:33.989746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:23:33.993736 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Getting quotas for user 08f7e9cf075d43b39802bbdc58cd604f and project 0c6c4204bde44a1183df1338d018b1b1. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:23:34.005410 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:23:34.007812 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67ce9639-3913-4323-9879-af93f04880cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:23:34.171175 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1ae2efe4-1add-4c28-b197-92a9fb37a01f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.702623 Apr 05 11:23:34.171733 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 597/1167] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:23:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:23:34.182576 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-41518c42-70a7-4de0-a886-6b24683cefb4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:34.183212 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-41518c42-70a7-4de0-a886-6b24683cefb4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:34.237228 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-41518c42-70a7-4de0-a886-6b24683cefb4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:34.245205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-41518c42-70a7-4de0-a886-6b24683cefb4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1241 microversion: 2.1 time: 0.066457 Apr 05 11:23:34.245863 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 571/1168] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:34 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:34.670479 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9c3bb9d6-9963-4b5b-b8f7-80066b2b9a50 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:34.671150 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9c3bb9d6-9963-4b5b-b8f7-80066b2b9a50 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:34.677631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9c3bb9d6-9963-4b5b-b8f7-80066b2b9a50 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:34.678084 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9c3bb9d6-9963-4b5b-b8f7-80066b2b9a50 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:34.679059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9c3bb9d6-9963-4b5b-b8f7-80066b2b9a50 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:34.679703 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9c3bb9d6-9963-4b5b-b8f7-80066b2b9a50 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:34.821290 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9c3bb9d6-9963-4b5b-b8f7-80066b2b9a50 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:34.830199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9c3bb9d6-9963-4b5b-b8f7-80066b2b9a50 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:34.831760 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9c3bb9d6-9963-4b5b-b8f7-80066b2b9a50 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:34.835920 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9c3bb9d6-9963-4b5b-b8f7-80066b2b9a50 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1744 microversion: 2.20 time: 0.167305 Apr 05 11:23:34.835920 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 598/1169] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:34 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:23:34.965109 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-df58427c-6acf-46c5-bdbb-9ebadfa8c319 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7140214-fd39-4be8-bbb8-da2f7e8506f5"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:34.966254 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-df58427c-6acf-46c5-bdbb-9ebadfa8c319 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:34.975252 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df58427c-6acf-46c5-bdbb-9ebadfa8c319 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:34.975919 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df58427c-6acf-46c5-bdbb-9ebadfa8c319 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:34.976724 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df58427c-6acf-46c5-bdbb-9ebadfa8c319 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:34.977191 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df58427c-6acf-46c5-bdbb-9ebadfa8c319 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:35.264995 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-abe097be-b26b-4254-b27e-a6447bb16d9a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:35.265930 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-abe097be-b26b-4254-b27e-a6447bb16d9a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:35.276640 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-abe097be-b26b-4254-b27e-a6447bb16d9a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:35.277211 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-abe097be-b26b-4254-b27e-a6447bb16d9a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:35.278021 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-abe097be-b26b-4254-b27e-a6447bb16d9a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:35.278454 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-abe097be-b26b-4254-b27e-a6447bb16d9a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:35.343049 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-abe097be-b26b-4254-b27e-a6447bb16d9a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:35.350975 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-abe097be-b26b-4254-b27e-a6447bb16d9a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1245 microversion: 2.1 time: 0.091308 Apr 05 11:23:35.358521 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 599/1170] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:35 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:23:35.852747 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ea6efa36-f2b6-4fd6-94c6-758d22cab418 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:35.853609 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ea6efa36-f2b6-4fd6-94c6-758d22cab418 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:35.860746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ea6efa36-f2b6-4fd6-94c6-758d22cab418 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:35.861193 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ea6efa36-f2b6-4fd6-94c6-758d22cab418 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:35.861953 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ea6efa36-f2b6-4fd6-94c6-758d22cab418 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:35.862380 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ea6efa36-f2b6-4fd6-94c6-758d22cab418 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:35.922175 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-df58427c-6acf-46c5-bdbb-9ebadfa8c319 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "POST /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.960909 Apr 05 11:23:35.923618 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 572/1171] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:23:34 2022] POST /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments => generated 194 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:36.012120 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ea6efa36-f2b6-4fd6-94c6-758d22cab418 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:36.021909 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ea6efa36-f2b6-4fd6-94c6-758d22cab418 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:36.023734 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ea6efa36-f2b6-4fd6-94c6-758d22cab418 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:36.025011 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ea6efa36-f2b6-4fd6-94c6-758d22cab418 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1744 microversion: 2.20 time: 0.176265 Apr 05 11:23:36.025668 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 600/1172] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:35 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:36.369614 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a0b2294a-7c57-4a11-9418-a5672a782b05 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:36.370963 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a0b2294a-7c57-4a11-9418-a5672a782b05 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:36.383272 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a0b2294a-7c57-4a11-9418-a5672a782b05 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:36.384022 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a0b2294a-7c57-4a11-9418-a5672a782b05 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:36.384960 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a0b2294a-7c57-4a11-9418-a5672a782b05 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:36.385559 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a0b2294a-7c57-4a11-9418-a5672a782b05 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:36.457894 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a0b2294a-7c57-4a11-9418-a5672a782b05 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:36.465779 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a0b2294a-7c57-4a11-9418-a5672a782b05 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1293 microversion: 2.1 time: 0.100811 Apr 05 11:23:36.466344 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 573/1173] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:36 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:37.050382 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1b59f2dd-3610-4d0e-aafe-29144a6d74e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:37.051135 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1b59f2dd-3610-4d0e-aafe-29144a6d74e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:37.059603 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b59f2dd-3610-4d0e-aafe-29144a6d74e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:37.060392 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b59f2dd-3610-4d0e-aafe-29144a6d74e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:37.061409 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b59f2dd-3610-4d0e-aafe-29144a6d74e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:37.061922 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b59f2dd-3610-4d0e-aafe-29144a6d74e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:37.229104 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1b59f2dd-3610-4d0e-aafe-29144a6d74e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:37.237846 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1b59f2dd-3610-4d0e-aafe-29144a6d74e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:37.239852 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1b59f2dd-3610-4d0e-aafe-29144a6d74e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:37.241023 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1b59f2dd-3610-4d0e-aafe-29144a6d74e8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1744 microversion: 2.20 time: 0.197105 Apr 05 11:23:37.241561 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 601/1174] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:37 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1744 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:37.483921 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1525bd94-04c1-4646-82b2-61d6ccdeaa50 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:37.484937 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1525bd94-04c1-4646-82b2-61d6ccdeaa50 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:37.494512 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1525bd94-04c1-4646-82b2-61d6ccdeaa50 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:37.495141 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1525bd94-04c1-4646-82b2-61d6ccdeaa50 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:37.496328 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1525bd94-04c1-4646-82b2-61d6ccdeaa50 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:37.496929 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1525bd94-04c1-4646-82b2-61d6ccdeaa50 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:37.678769 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1525bd94-04c1-4646-82b2-61d6ccdeaa50 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:37.686592 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1525bd94-04c1-4646-82b2-61d6ccdeaa50 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1367 microversion: 2.1 time: 0.207098 Apr 05 11:23:37.687524 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 574/1175] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:37 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:38.268626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ba0301d3-b2a5-417e-ad83-091b1b80177f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:38.269990 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ba0301d3-b2a5-417e-ad83-091b1b80177f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:38.277627 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ba0301d3-b2a5-417e-ad83-091b1b80177f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:38.278292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ba0301d3-b2a5-417e-ad83-091b1b80177f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:38.279253 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ba0301d3-b2a5-417e-ad83-091b1b80177f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:38.279879 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ba0301d3-b2a5-417e-ad83-091b1b80177f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:38.364477 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-eaae529b-c781-42a4-bde4-05e1c1ec4f03 req-0cd53b4d-0bda-4406-9abd-f3b4e30d1664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "078668ec-0695-4717-bef7-1153cdc2dd14", "name": "network-vif-plugged", "status": "completed", "tag": "f631937a-090e-4c88-959c-bbf9308dfac9"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:38.372698 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-eaae529b-c781-42a4-bde4-05e1c1ec4f03 req-0cd53b4d-0bda-4406-9abd-f3b4e30d1664 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:38.373155 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-eaae529b-c781-42a4-bde4-05e1c1ec4f03 req-0cd53b4d-0bda-4406-9abd-f3b4e30d1664 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:38.385164 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-eaae529b-c781-42a4-bde4-05e1c1ec4f03 req-0cd53b4d-0bda-4406-9abd-f3b4e30d1664 service nova] Creating event network-vif-plugged:f631937a-090e-4c88-959c-bbf9308dfac9 for instance 078668ec-0695-4717-bef7-1153cdc2dd14 on hv-cinder-81899 Apr 05 11:23:38.391268 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-eaae529b-c781-42a4-bde4-05e1c1ec4f03 req-0cd53b4d-0bda-4406-9abd-f3b4e30d1664 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031235 Apr 05 11:23:38.392851 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 575/1176] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:23:38.455235 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ba0301d3-b2a5-417e-ad83-091b1b80177f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:38.463740 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ba0301d3-b2a5-417e-ad83-091b1b80177f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:38.465282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ba0301d3-b2a5-417e-ad83-091b1b80177f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:38.466493 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ba0301d3-b2a5-417e-ad83-091b1b80177f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1744 microversion: 2.20 time: 0.203998 Apr 05 11:23:38.475230 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 602/1177] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:38 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:38.511333 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-7888412e-0b0c-4758-82e5-2e14a4becc41 req-edf64cf2-45fb-4271-9397-44d34b769343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339ba379-b00c-4220-889a-d8058c31b068", "tag": "c79699ad-777d-4577-a688-07225906c890"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:38.521134 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-7888412e-0b0c-4758-82e5-2e14a4becc41 req-edf64cf2-45fb-4271-9397-44d34b769343 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:38.521865 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-7888412e-0b0c-4758-82e5-2e14a4becc41 req-edf64cf2-45fb-4271-9397-44d34b769343 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:38.543908 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-7888412e-0b0c-4758-82e5-2e14a4becc41 req-edf64cf2-45fb-4271-9397-44d34b769343 service nova] Creating event network-changed:c79699ad-777d-4577-a688-07225906c890 for instance 339ba379-b00c-4220-889a-d8058c31b068 on hv-cinder-81899 Apr 05 11:23:38.549967 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-7888412e-0b0c-4758-82e5-2e14a4becc41 req-edf64cf2-45fb-4271-9397-44d34b769343 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042952 Apr 05 11:23:38.551134 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 576/1178] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:38.703837 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e20e15a7-2f94-462b-a88a-61025c1d57f2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:38.704443 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e20e15a7-2f94-462b-a88a-61025c1d57f2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:38.710226 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e20e15a7-2f94-462b-a88a-61025c1d57f2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:38.710706 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e20e15a7-2f94-462b-a88a-61025c1d57f2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:38.711469 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e20e15a7-2f94-462b-a88a-61025c1d57f2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:38.712083 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e20e15a7-2f94-462b-a88a-61025c1d57f2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:38.846682 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e20e15a7-2f94-462b-a88a-61025c1d57f2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:38.852434 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e20e15a7-2f94-462b-a88a-61025c1d57f2 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1367 microversion: 2.1 time: 0.152483 Apr 05 11:23:38.853021 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 603/1179] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:38 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:39.493995 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a172b483-a679-4b54-90ca-c5d25c4e5e4f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:39.494731 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a172b483-a679-4b54-90ca-c5d25c4e5e4f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:39.500813 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a172b483-a679-4b54-90ca-c5d25c4e5e4f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:39.501273 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a172b483-a679-4b54-90ca-c5d25c4e5e4f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:39.502058 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a172b483-a679-4b54-90ca-c5d25c4e5e4f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:39.503002 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a172b483-a679-4b54-90ca-c5d25c4e5e4f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:39.668852 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a172b483-a679-4b54-90ca-c5d25c4e5e4f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:39.676719 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a172b483-a679-4b54-90ca-c5d25c4e5e4f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:39.679320 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a172b483-a679-4b54-90ca-c5d25c4e5e4f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:39.679435 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a172b483-a679-4b54-90ca-c5d25c4e5e4f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1744 microversion: 2.20 time: 0.189779 Apr 05 11:23:39.679899 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 577/1180] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:39 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:39.870306 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0fc5be0f-593a-48fb-84ac-6cd21f7a5dec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:39.870887 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0fc5be0f-593a-48fb-84ac-6cd21f7a5dec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:39.877345 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0fc5be0f-593a-48fb-84ac-6cd21f7a5dec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:39.877803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0fc5be0f-593a-48fb-84ac-6cd21f7a5dec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:39.878571 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0fc5be0f-593a-48fb-84ac-6cd21f7a5dec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:39.879030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0fc5be0f-593a-48fb-84ac-6cd21f7a5dec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:40.019739 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0fc5be0f-593a-48fb-84ac-6cd21f7a5dec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:40.029166 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0fc5be0f-593a-48fb-84ac-6cd21f7a5dec tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1367 microversion: 2.1 time: 0.162889 Apr 05 11:23:40.029748 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 604/1181] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:39 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:40.697583 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e9e9179e-8e64-4b2e-acaa-fadbc56f7c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:40.698263 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e9e9179e-8e64-4b2e-acaa-fadbc56f7c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:40.705145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e9e9179e-8e64-4b2e-acaa-fadbc56f7c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:40.705600 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e9e9179e-8e64-4b2e-acaa-fadbc56f7c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:40.706421 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e9e9179e-8e64-4b2e-acaa-fadbc56f7c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:40.706880 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e9e9179e-8e64-4b2e-acaa-fadbc56f7c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:40.892302 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e9e9179e-8e64-4b2e-acaa-fadbc56f7c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:40.900142 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e9e9179e-8e64-4b2e-acaa-fadbc56f7c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:40.901650 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e9e9179e-8e64-4b2e-acaa-fadbc56f7c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:40.905001 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e9e9179e-8e64-4b2e-acaa-fadbc56f7c66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1744 microversion: 2.20 time: 0.209444 Apr 05 11:23:40.905001 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 578/1182] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:40 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1744 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:41.055786 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2ed5d554-f615-4097-9623-fd28fbac6926 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:41.056675 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2ed5d554-f615-4097-9623-fd28fbac6926 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:41.067858 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2ed5d554-f615-4097-9623-fd28fbac6926 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:41.071143 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2ed5d554-f615-4097-9623-fd28fbac6926 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:41.071143 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2ed5d554-f615-4097-9623-fd28fbac6926 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:41.071143 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2ed5d554-f615-4097-9623-fd28fbac6926 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:41.224967 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2ed5d554-f615-4097-9623-fd28fbac6926 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:41.232157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2ed5d554-f615-4097-9623-fd28fbac6926 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1367 microversion: 2.1 time: 0.180434 Apr 05 11:23:41.232944 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 605/1183] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:41 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:41.921991 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a7906145-4d38-4c1d-9421-05ef873f27d0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:41.922749 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a7906145-4d38-4c1d-9421-05ef873f27d0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:41.929066 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7906145-4d38-4c1d-9421-05ef873f27d0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:41.932497 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7906145-4d38-4c1d-9421-05ef873f27d0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:41.932497 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7906145-4d38-4c1d-9421-05ef873f27d0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:41.932497 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7906145-4d38-4c1d-9421-05ef873f27d0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:42.068633 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a7906145-4d38-4c1d-9421-05ef873f27d0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:42.076330 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a7906145-4d38-4c1d-9421-05ef873f27d0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:42.077832 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a7906145-4d38-4c1d-9421-05ef873f27d0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:42.079084 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a7906145-4d38-4c1d-9421-05ef873f27d0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1744 microversion: 2.20 time: 0.161372 Apr 05 11:23:42.079805 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 579/1184] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:41 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:42.253564 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-10446dae-17cb-4b56-b461-f6e069ba2ffe tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:42.253564 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-10446dae-17cb-4b56-b461-f6e069ba2ffe tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:42.256269 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10446dae-17cb-4b56-b461-f6e069ba2ffe tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:42.256717 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10446dae-17cb-4b56-b461-f6e069ba2ffe tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:42.257542 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10446dae-17cb-4b56-b461-f6e069ba2ffe tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:42.257919 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10446dae-17cb-4b56-b461-f6e069ba2ffe tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:42.390067 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-10446dae-17cb-4b56-b461-f6e069ba2ffe tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:42.398261 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-10446dae-17cb-4b56-b461-f6e069ba2ffe tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1367 microversion: 2.1 time: 0.152895 Apr 05 11:23:42.398906 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 606/1185] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:42 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:23:43.097397 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a59fe9c2-d506-40fb-ae91-ad88530421af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:43.098139 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a59fe9c2-d506-40fb-ae91-ad88530421af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:43.104334 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a59fe9c2-d506-40fb-ae91-ad88530421af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:43.104779 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a59fe9c2-d506-40fb-ae91-ad88530421af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:43.105541 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a59fe9c2-d506-40fb-ae91-ad88530421af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:43.105970 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a59fe9c2-d506-40fb-ae91-ad88530421af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:43.256615 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a59fe9c2-d506-40fb-ae91-ad88530421af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:43.264728 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a59fe9c2-d506-40fb-ae91-ad88530421af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:43.266433 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a59fe9c2-d506-40fb-ae91-ad88530421af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:43.267646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a59fe9c2-d506-40fb-ae91-ad88530421af tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.174059 Apr 05 11:23:43.268201 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 580/1186] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:43 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:43.415562 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-cd31fc0a-31a6-4e89-ac33-662c88a5c516 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:43.416169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-cd31fc0a-31a6-4e89-ac33-662c88a5c516 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:43.422543 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd31fc0a-31a6-4e89-ac33-662c88a5c516 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:43.423041 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd31fc0a-31a6-4e89-ac33-662c88a5c516 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:43.423822 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd31fc0a-31a6-4e89-ac33-662c88a5c516 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:43.424257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd31fc0a-31a6-4e89-ac33-662c88a5c516 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:43.814653 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cd31fc0a-31a6-4e89-ac33-662c88a5c516 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:43.822251 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-cd31fc0a-31a6-4e89-ac33-662c88a5c516 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1367 microversion: 2.1 time: 0.410547 Apr 05 11:23:43.822857 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 607/1187] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:43 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1367 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:44.289068 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-54587e5a-c86e-41a8-81d0-bda115e72e71 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:44.289684 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-54587e5a-c86e-41a8-81d0-bda115e72e71 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:44.296273 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54587e5a-c86e-41a8-81d0-bda115e72e71 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:44.296673 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54587e5a-c86e-41a8-81d0-bda115e72e71 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:44.297447 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54587e5a-c86e-41a8-81d0-bda115e72e71 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:44.297888 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54587e5a-c86e-41a8-81d0-bda115e72e71 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:44.434121 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-54587e5a-c86e-41a8-81d0-bda115e72e71 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:44.443386 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-54587e5a-c86e-41a8-81d0-bda115e72e71 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:44.444910 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-54587e5a-c86e-41a8-81d0-bda115e72e71 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:44.446110 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-54587e5a-c86e-41a8-81d0-bda115e72e71 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.161102 Apr 05 11:23:44.446713 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 581/1188] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:44 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:44.753541 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0c4a1f9e-452c-4dff-98eb-84c5ff28751e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:44.755142 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0c4a1f9e-452c-4dff-98eb-84c5ff28751e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:44.766882 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c4a1f9e-452c-4dff-98eb-84c5ff28751e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:44.767398 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c4a1f9e-452c-4dff-98eb-84c5ff28751e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:44.768273 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c4a1f9e-452c-4dff-98eb-84c5ff28751e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:44.768813 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c4a1f9e-452c-4dff-98eb-84c5ff28751e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:44.811463 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0c4a1f9e-452c-4dff-98eb-84c5ff28751e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061949 Apr 05 11:23:44.812548 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 608/1189] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:23:44 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:44.824107 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f2442616-2426-4a3d-88e0-755dc7046c03 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:44.825040 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f2442616-2426-4a3d-88e0-755dc7046c03 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:44.836003 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2442616-2426-4a3d-88e0-755dc7046c03 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:44.836726 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2442616-2426-4a3d-88e0-755dc7046c03 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:44.838734 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2442616-2426-4a3d-88e0-755dc7046c03 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:44.839914 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2442616-2426-4a3d-88e0-755dc7046c03 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:44.840354 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4c78b62c-1943-4ba1-b6c5-8b69b9b90e63 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:44.842015 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4c78b62c-1943-4ba1-b6c5-8b69b9b90e63 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:44.852077 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c78b62c-1943-4ba1-b6c5-8b69b9b90e63 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:44.854699 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c78b62c-1943-4ba1-b6c5-8b69b9b90e63 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:44.854699 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c78b62c-1943-4ba1-b6c5-8b69b9b90e63 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:44.854699 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c78b62c-1943-4ba1-b6c5-8b69b9b90e63 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:44.893582 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f2442616-2426-4a3d-88e0-755dc7046c03 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments/e7140214-fd39-4be8-bbb8-da2f7e8506f5" status: 200 len: 194 microversion: 2.1 time: 0.074464 Apr 05 11:23:44.895022 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 582/1190] 10.222.0.39 () {58 vars in 1412 bytes} [Tue Apr 5 11:23:44 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments/e7140214-fd39-4be8-bbb8-da2f7e8506f5 => generated 194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:45.014312 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4c78b62c-1943-4ba1-b6c5-8b69b9b90e63 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:45.024320 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4c78b62c-1943-4ba1-b6c5-8b69b9b90e63 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1367 microversion: 2.1 time: 0.188577 Apr 05 11:23:45.026535 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 609/1191] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:44 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:23:45.464640 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-632d26df-d7eb-433c-8631-0b63b4bc30e9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:45.465607 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-632d26df-d7eb-433c-8631-0b63b4bc30e9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:45.472356 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-632d26df-d7eb-433c-8631-0b63b4bc30e9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:45.474806 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-632d26df-d7eb-433c-8631-0b63b4bc30e9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:45.474806 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-632d26df-d7eb-433c-8631-0b63b4bc30e9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:45.475682 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-632d26df-d7eb-433c-8631-0b63b4bc30e9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:45.646021 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-632d26df-d7eb-433c-8631-0b63b4bc30e9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:45.658302 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-632d26df-d7eb-433c-8631-0b63b4bc30e9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:45.658302 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-632d26df-d7eb-433c-8631-0b63b4bc30e9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:45.658837 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-632d26df-d7eb-433c-8631-0b63b4bc30e9 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.198461 Apr 05 11:23:45.659394 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 583/1192] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:45 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:23:46.041523 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-267ba2d6-10be-4dd0-9576-51cfff130688 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:46.042255 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-267ba2d6-10be-4dd0-9576-51cfff130688 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:46.049969 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-267ba2d6-10be-4dd0-9576-51cfff130688 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:46.050451 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-267ba2d6-10be-4dd0-9576-51cfff130688 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:46.051798 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-267ba2d6-10be-4dd0-9576-51cfff130688 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:46.052243 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-267ba2d6-10be-4dd0-9576-51cfff130688 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:46.228573 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-267ba2d6-10be-4dd0-9576-51cfff130688 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:46.239343 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-267ba2d6-10be-4dd0-9576-51cfff130688 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1367 microversion: 2.1 time: 0.200567 Apr 05 11:23:46.241896 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 610/1193] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:46 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:46.390949 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-1b82b288-8bc5-402a-a32a-ec3e39aad5df req-768636da-ffa9-493c-b5f6-78264b3142c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339ba379-b00c-4220-889a-d8058c31b068", "name": "network-vif-plugged", "status": "completed", "tag": "c79699ad-777d-4577-a688-07225906c890"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:46.402408 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-1b82b288-8bc5-402a-a32a-ec3e39aad5df req-768636da-ffa9-493c-b5f6-78264b3142c0 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:46.402951 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-1b82b288-8bc5-402a-a32a-ec3e39aad5df req-768636da-ffa9-493c-b5f6-78264b3142c0 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:46.416107 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-1b82b288-8bc5-402a-a32a-ec3e39aad5df req-768636da-ffa9-493c-b5f6-78264b3142c0 service nova] Creating event network-vif-plugged:c79699ad-777d-4577-a688-07225906c890 for instance 339ba379-b00c-4220-889a-d8058c31b068 on hv-cinder-81899 Apr 05 11:23:46.421245 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-1b82b288-8bc5-402a-a32a-ec3e39aad5df req-768636da-ffa9-493c-b5f6-78264b3142c0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042415 Apr 05 11:23:46.421992 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 584/1194] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:46.678492 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-796df799-f409-4e37-ab0e-31bc1ec85e10 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:46.679316 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-796df799-f409-4e37-ab0e-31bc1ec85e10 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:46.688458 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-796df799-f409-4e37-ab0e-31bc1ec85e10 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:46.689312 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-796df799-f409-4e37-ab0e-31bc1ec85e10 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:46.689812 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-796df799-f409-4e37-ab0e-31bc1ec85e10 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:46.692952 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-796df799-f409-4e37-ab0e-31bc1ec85e10 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:46.888145 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-796df799-f409-4e37-ab0e-31bc1ec85e10 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:46.897475 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-796df799-f409-4e37-ab0e-31bc1ec85e10 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:46.899418 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-796df799-f409-4e37-ab0e-31bc1ec85e10 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:46.900601 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-796df799-f409-4e37-ab0e-31bc1ec85e10 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.227412 Apr 05 11:23:46.901164 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 611/1195] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:46 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:47.259950 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c3a6a773-2f4d-44f3-8cc0-b001a56484d5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:47.261603 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c3a6a773-2f4d-44f3-8cc0-b001a56484d5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:47.269290 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c3a6a773-2f4d-44f3-8cc0-b001a56484d5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:47.273912 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c3a6a773-2f4d-44f3-8cc0-b001a56484d5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:47.273912 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c3a6a773-2f4d-44f3-8cc0-b001a56484d5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:47.273912 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c3a6a773-2f4d-44f3-8cc0-b001a56484d5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:47.460697 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c3a6a773-2f4d-44f3-8cc0-b001a56484d5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:47.472257 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c3a6a773-2f4d-44f3-8cc0-b001a56484d5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1367 microversion: 2.1 time: 0.217505 Apr 05 11:23:47.473925 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 585/1196] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:47 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:47.781352 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7f496e85-a408-425a-b62b-9e110ffeeb91 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b308b340-aec4-4f6f-9051-b5a2bf78eb37"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:47.782428 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7f496e85-a408-425a-b62b-9e110ffeeb91 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:47.789521 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f496e85-a408-425a-b62b-9e110ffeeb91 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:47.789956 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f496e85-a408-425a-b62b-9e110ffeeb91 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:47.790716 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f496e85-a408-425a-b62b-9e110ffeeb91 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:47.791159 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f496e85-a408-425a-b62b-9e110ffeeb91 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:47.918893 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-00f5f904-a3ba-475d-a320-6c5ace725081 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:47.919504 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-00f5f904-a3ba-475d-a320-6c5ace725081 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:47.925455 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00f5f904-a3ba-475d-a320-6c5ace725081 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:47.925908 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00f5f904-a3ba-475d-a320-6c5ace725081 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:47.926754 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00f5f904-a3ba-475d-a320-6c5ace725081 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:47.927275 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00f5f904-a3ba-475d-a320-6c5ace725081 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:48.062024 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-00f5f904-a3ba-475d-a320-6c5ace725081 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:48.071166 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-00f5f904-a3ba-475d-a320-6c5ace725081 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:48.072613 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-00f5f904-a3ba-475d-a320-6c5ace725081 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:48.073768 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-00f5f904-a3ba-475d-a320-6c5ace725081 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.158815 Apr 05 11:23:48.074319 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 586/1197] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:47 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:23:48.495724 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e0136e70-44c5-4c0a-98a3-4e17a34fbd5e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:48.497054 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e0136e70-44c5-4c0a-98a3-4e17a34fbd5e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:48.503718 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0136e70-44c5-4c0a-98a3-4e17a34fbd5e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:48.504928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0136e70-44c5-4c0a-98a3-4e17a34fbd5e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:48.505890 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0136e70-44c5-4c0a-98a3-4e17a34fbd5e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:48.506490 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0136e70-44c5-4c0a-98a3-4e17a34fbd5e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:48.928952 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e0136e70-44c5-4c0a-98a3-4e17a34fbd5e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:48.936437 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e0136e70-44c5-4c0a-98a3-4e17a34fbd5e tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1367 microversion: 2.1 time: 0.444559 Apr 05 11:23:48.948914 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 587/1198] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:48 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1367 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:23:49.094409 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a98eb9f9-cee2-42cf-8568-bfab1fcbf42e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:49.095131 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a98eb9f9-cee2-42cf-8568-bfab1fcbf42e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:49.102534 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a98eb9f9-cee2-42cf-8568-bfab1fcbf42e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:49.103374 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a98eb9f9-cee2-42cf-8568-bfab1fcbf42e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:49.104244 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a98eb9f9-cee2-42cf-8568-bfab1fcbf42e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:49.105020 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a98eb9f9-cee2-42cf-8568-bfab1fcbf42e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:49.250355 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a98eb9f9-cee2-42cf-8568-bfab1fcbf42e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:49.261190 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a98eb9f9-cee2-42cf-8568-bfab1fcbf42e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:49.262729 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a98eb9f9-cee2-42cf-8568-bfab1fcbf42e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:49.263926 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a98eb9f9-cee2-42cf-8568-bfab1fcbf42e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.175220 Apr 05 11:23:49.264484 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 588/1199] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:49 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:49.629217 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:23:49.629864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: Tue Apr 5 11:23:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:23:49.959235 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bf7e6ece-5cf5-4b4d-9aee-2297ece0ba8d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:49.960304 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bf7e6ece-5cf5-4b4d-9aee-2297ece0ba8d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:49.966903 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf7e6ece-5cf5-4b4d-9aee-2297ece0ba8d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:49.967354 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf7e6ece-5cf5-4b4d-9aee-2297ece0ba8d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:49.968170 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf7e6ece-5cf5-4b4d-9aee-2297ece0ba8d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:49.968610 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf7e6ece-5cf5-4b4d-9aee-2297ece0ba8d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:50.123913 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bf7e6ece-5cf5-4b4d-9aee-2297ece0ba8d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:50.132379 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bf7e6ece-5cf5-4b4d-9aee-2297ece0ba8d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1367 microversion: 2.1 time: 0.179641 Apr 05 11:23:50.133693 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 589/1200] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:49 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:23:50.283475 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5743146b-f7b8-4aad-9689-bf2d1f064ea4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:50.284246 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5743146b-f7b8-4aad-9689-bf2d1f064ea4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:50.291370 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5743146b-f7b8-4aad-9689-bf2d1f064ea4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:50.291817 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5743146b-f7b8-4aad-9689-bf2d1f064ea4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:50.292658 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5743146b-f7b8-4aad-9689-bf2d1f064ea4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:50.293037 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5743146b-f7b8-4aad-9689-bf2d1f064ea4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:50.436320 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5743146b-f7b8-4aad-9689-bf2d1f064ea4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:50.445343 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5743146b-f7b8-4aad-9689-bf2d1f064ea4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:50.446947 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5743146b-f7b8-4aad-9689-bf2d1f064ea4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:50.448111 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5743146b-f7b8-4aad-9689-bf2d1f064ea4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.169446 Apr 05 11:23:50.449098 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 590/1201] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:50 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:23:51.149393 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2d64c2ed-b6aa-4caa-ab1d-21196961c02d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:51.150106 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2d64c2ed-b6aa-4caa-ab1d-21196961c02d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:51.156447 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d64c2ed-b6aa-4caa-ab1d-21196961c02d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:51.156899 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d64c2ed-b6aa-4caa-ab1d-21196961c02d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:51.157668 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d64c2ed-b6aa-4caa-ab1d-21196961c02d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:51.158103 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2d64c2ed-b6aa-4caa-ab1d-21196961c02d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:51.292819 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2d64c2ed-b6aa-4caa-ab1d-21196961c02d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:51.300087 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2d64c2ed-b6aa-4caa-ab1d-21196961c02d tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1367 microversion: 2.1 time: 0.154767 Apr 05 11:23:51.300699 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 591/1202] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:51 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:23:51.467321 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dbf13ea6-e2d5-409d-81ef-b8619d888de5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:51.467321 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dbf13ea6-e2d5-409d-81ef-b8619d888de5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:51.472928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbf13ea6-e2d5-409d-81ef-b8619d888de5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:51.473381 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbf13ea6-e2d5-409d-81ef-b8619d888de5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:51.474271 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbf13ea6-e2d5-409d-81ef-b8619d888de5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:51.474748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbf13ea6-e2d5-409d-81ef-b8619d888de5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:51.624244 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dbf13ea6-e2d5-409d-81ef-b8619d888de5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:51.640702 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dbf13ea6-e2d5-409d-81ef-b8619d888de5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:51.642432 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dbf13ea6-e2d5-409d-81ef-b8619d888de5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:51.643762 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dbf13ea6-e2d5-409d-81ef-b8619d888de5 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.181612 Apr 05 11:23:51.644458 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 592/1203] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:51 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:23:52.325936 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8907bb0f-2239-4237-a675-d2c991fd2bb5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:52.326660 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8907bb0f-2239-4237-a675-d2c991fd2bb5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:52.336773 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8907bb0f-2239-4237-a675-d2c991fd2bb5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:52.339635 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8907bb0f-2239-4237-a675-d2c991fd2bb5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:52.341088 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8907bb0f-2239-4237-a675-d2c991fd2bb5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:52.341549 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8907bb0f-2239-4237-a675-d2c991fd2bb5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:52.500334 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8907bb0f-2239-4237-a675-d2c991fd2bb5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:52.514577 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8907bb0f-2239-4237-a675-d2c991fd2bb5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1367 microversion: 2.1 time: 0.190450 Apr 05 11:23:52.517619 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 593/1204] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:52 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:23:52.662575 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6ebc82ac-3132-49c9-a1dc-c9192f607e5b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:52.663578 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6ebc82ac-3132-49c9-a1dc-c9192f607e5b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:52.669499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6ebc82ac-3132-49c9-a1dc-c9192f607e5b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:52.669946 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6ebc82ac-3132-49c9-a1dc-c9192f607e5b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:52.670750 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6ebc82ac-3132-49c9-a1dc-c9192f607e5b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:52.671246 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6ebc82ac-3132-49c9-a1dc-c9192f607e5b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:52.692895 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7f496e85-a408-425a-b62b-9e110ffeeb91 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "POST /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.915293 Apr 05 11:23:52.698095 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 612/1205] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:23:47 2022] POST /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments => generated 194 bytes in 4917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:52.840877 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6ebc82ac-3132-49c9-a1dc-c9192f607e5b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:52.854569 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6ebc82ac-3132-49c9-a1dc-c9192f607e5b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:52.856289 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6ebc82ac-3132-49c9-a1dc-c9192f607e5b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:52.858057 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6ebc82ac-3132-49c9-a1dc-c9192f607e5b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.199325 Apr 05 11:23:52.859279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 594/1206] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:52 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:23:53.536326 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d6fcbccc-617f-4145-92b7-ca9127228f9f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:53.542038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d6fcbccc-617f-4145-92b7-ca9127228f9f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:53.544459 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d6fcbccc-617f-4145-92b7-ca9127228f9f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:53.544909 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d6fcbccc-617f-4145-92b7-ca9127228f9f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:53.545668 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d6fcbccc-617f-4145-92b7-ca9127228f9f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:53.546100 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d6fcbccc-617f-4145-92b7-ca9127228f9f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:53.723326 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d6fcbccc-617f-4145-92b7-ca9127228f9f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:53.732089 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d6fcbccc-617f-4145-92b7-ca9127228f9f tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1557 microversion: 2.1 time: 0.200447 Apr 05 11:23:53.732885 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 613/1207] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:23:53 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1557 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:23:53.750737 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a356c651-6365-453d-b71e-73518f7aaf4c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:53.756896 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a356c651-6365-453d-b71e-73518f7aaf4c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:53.758509 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a356c651-6365-453d-b71e-73518f7aaf4c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:53.758991 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a356c651-6365-453d-b71e-73518f7aaf4c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:53.759788 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a356c651-6365-453d-b71e-73518f7aaf4c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:53.760243 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a356c651-6365-453d-b71e-73518f7aaf4c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:53.876895 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-55c1c08d-e9dd-45b1-8d3d-18b2c8db1735 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:53.879150 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-55c1c08d-e9dd-45b1-8d3d-18b2c8db1735 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:53.881689 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a356c651-6365-453d-b71e-73518f7aaf4c tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134722 Apr 05 11:23:53.883094 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 595/1208] 10.222.0.39 () {58 vars in 1274 bytes} [Tue Apr 5 11:23:53 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:53.893244 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55c1c08d-e9dd-45b1-8d3d-18b2c8db1735 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:53.893878 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55c1c08d-e9dd-45b1-8d3d-18b2c8db1735 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:53.895114 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55c1c08d-e9dd-45b1-8d3d-18b2c8db1735 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:53.895870 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55c1c08d-e9dd-45b1-8d3d-18b2c8db1735 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:54.234518 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-55c1c08d-e9dd-45b1-8d3d-18b2c8db1735 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:54.250551 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-55c1c08d-e9dd-45b1-8d3d-18b2c8db1735 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:54.252842 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-55c1c08d-e9dd-45b1-8d3d-18b2c8db1735 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:54.254876 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-55c1c08d-e9dd-45b1-8d3d-18b2c8db1735 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.382249 Apr 05 11:23:54.255449 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 614/1209] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:53 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:23:55.227499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-4cb2ffe8-ad73-441e-a0cf-1a6ec5cd3e67 req-5999cd09-2e74-4173-990f-cd3fa7cd78f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339ba379-b00c-4220-889a-d8058c31b068", "tag": "c79699ad-777d-4577-a688-07225906c890"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:23:55.236776 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-4cb2ffe8-ad73-441e-a0cf-1a6ec5cd3e67 req-5999cd09-2e74-4173-990f-cd3fa7cd78f9 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:55.237221 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-4cb2ffe8-ad73-441e-a0cf-1a6ec5cd3e67 req-5999cd09-2e74-4173-990f-cd3fa7cd78f9 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:55.248654 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-4cb2ffe8-ad73-441e-a0cf-1a6ec5cd3e67 req-5999cd09-2e74-4173-990f-cd3fa7cd78f9 service nova] Creating event network-changed:c79699ad-777d-4577-a688-07225906c890 for instance 339ba379-b00c-4220-889a-d8058c31b068 on hv-cinder-81899 Apr 05 11:23:55.253858 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-4cb2ffe8-ad73-441e-a0cf-1a6ec5cd3e67 req-5999cd09-2e74-4173-990f-cd3fa7cd78f9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029944 Apr 05 11:23:55.254460 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 596/1210] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:23:55.276039 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d6de9dce-0f5b-49d6-b969-469cda60bb6b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:55.276643 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d6de9dce-0f5b-49d6-b969-469cda60bb6b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:55.283316 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d6de9dce-0f5b-49d6-b969-469cda60bb6b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:55.290927 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d6de9dce-0f5b-49d6-b969-469cda60bb6b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:55.290927 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d6de9dce-0f5b-49d6-b969-469cda60bb6b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:55.290927 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d6de9dce-0f5b-49d6-b969-469cda60bb6b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:55.423914 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d6de9dce-0f5b-49d6-b969-469cda60bb6b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:55.432383 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d6de9dce-0f5b-49d6-b969-469cda60bb6b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:55.433874 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d6de9dce-0f5b-49d6-b969-469cda60bb6b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:55.435067 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d6de9dce-0f5b-49d6-b969-469cda60bb6b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.163122 Apr 05 11:23:55.435642 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 615/1211] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:55 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:56.453341 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b5145b04-57bd-4bc9-b51b-3283057db70c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:56.454890 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b5145b04-57bd-4bc9-b51b-3283057db70c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:56.461857 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5145b04-57bd-4bc9-b51b-3283057db70c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:56.462595 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5145b04-57bd-4bc9-b51b-3283057db70c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:56.463636 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5145b04-57bd-4bc9-b51b-3283057db70c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:56.468606 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5145b04-57bd-4bc9-b51b-3283057db70c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:56.616171 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b5145b04-57bd-4bc9-b51b-3283057db70c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:56.624191 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b5145b04-57bd-4bc9-b51b-3283057db70c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:56.625699 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b5145b04-57bd-4bc9-b51b-3283057db70c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:56.626907 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b5145b04-57bd-4bc9-b51b-3283057db70c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.178345 Apr 05 11:23:56.627474 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 597/1212] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:56 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:57.645131 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ed0949ba-e8d1-4a52-84cd-6d218199246b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:57.645665 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ed0949ba-e8d1-4a52-84cd-6d218199246b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:57.652201 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ed0949ba-e8d1-4a52-84cd-6d218199246b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:57.652648 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ed0949ba-e8d1-4a52-84cd-6d218199246b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:57.653410 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ed0949ba-e8d1-4a52-84cd-6d218199246b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:57.653843 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ed0949ba-e8d1-4a52-84cd-6d218199246b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:57.788591 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ed0949ba-e8d1-4a52-84cd-6d218199246b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:57.796260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ed0949ba-e8d1-4a52-84cd-6d218199246b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:57.797750 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ed0949ba-e8d1-4a52-84cd-6d218199246b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:57.798933 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ed0949ba-e8d1-4a52-84cd-6d218199246b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.157861 Apr 05 11:23:57.799485 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 616/1213] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:57 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:58.817270 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-55c217bf-c7db-4bb2-b01b-86053ca86195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:58.818501 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-55c217bf-c7db-4bb2-b01b-86053ca86195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:58.824731 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-55c217bf-c7db-4bb2-b01b-86053ca86195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:58.825177 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-55c217bf-c7db-4bb2-b01b-86053ca86195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:58.825943 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-55c217bf-c7db-4bb2-b01b-86053ca86195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:58.826373 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-55c217bf-c7db-4bb2-b01b-86053ca86195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:58.960744 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-55c217bf-c7db-4bb2-b01b-86053ca86195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:58.968507 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-55c217bf-c7db-4bb2-b01b-86053ca86195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:58.970021 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-55c217bf-c7db-4bb2-b01b-86053ca86195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:23:58.971198 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-55c217bf-c7db-4bb2-b01b-86053ca86195 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.158063 Apr 05 11:23:58.971756 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 598/1214] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:58 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:23:59.989621 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b51e88c7-c717-4c17-8cb7-32baee3364d7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:23:59.990229 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b51e88c7-c717-4c17-8cb7-32baee3364d7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:23:59.996545 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b51e88c7-c717-4c17-8cb7-32baee3364d7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:59.996997 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b51e88c7-c717-4c17-8cb7-32baee3364d7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:23:59.997771 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b51e88c7-c717-4c17-8cb7-32baee3364d7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:23:59.998198 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b51e88c7-c717-4c17-8cb7-32baee3364d7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:00.131236 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b51e88c7-c717-4c17-8cb7-32baee3364d7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:00.140338 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b51e88c7-c717-4c17-8cb7-32baee3364d7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:00.144300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b51e88c7-c717-4c17-8cb7-32baee3364d7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:00.144300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b51e88c7-c717-4c17-8cb7-32baee3364d7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1739 microversion: 2.20 time: 0.157382 Apr 05 11:24:00.144300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 617/1215] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:23:59 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:01.161436 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dbf950fd-3684-4969-aad6-b9a605364c3f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:01.162059 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dbf950fd-3684-4969-aad6-b9a605364c3f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:01.168562 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbf950fd-3684-4969-aad6-b9a605364c3f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:01.169019 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbf950fd-3684-4969-aad6-b9a605364c3f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:01.169795 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbf950fd-3684-4969-aad6-b9a605364c3f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:01.170235 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbf950fd-3684-4969-aad6-b9a605364c3f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:01.410094 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dbf950fd-3684-4969-aad6-b9a605364c3f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:01.419080 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dbf950fd-3684-4969-aad6-b9a605364c3f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:01.420614 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dbf950fd-3684-4969-aad6-b9a605364c3f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:01.421830 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dbf950fd-3684-4969-aad6-b9a605364c3f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1721 microversion: 2.20 time: 0.264488 Apr 05 11:24:01.422478 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 599/1216] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:01 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:02.246916 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-1517b7e2-10a1-4e20-9d82-ee471ef173a8 req-b4d81aff-175a-4c63-8564-d0ff8451f952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "078668ec-0695-4717-bef7-1153cdc2dd14", "name": "network-vif-unplugged", "status": "completed", "tag": "f631937a-090e-4c88-959c-bbf9308dfac9"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:24:02.263293 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-1517b7e2-10a1-4e20-9d82-ee471ef173a8 req-b4d81aff-175a-4c63-8564-d0ff8451f952 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:02.263293 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-1517b7e2-10a1-4e20-9d82-ee471ef173a8 req-b4d81aff-175a-4c63-8564-d0ff8451f952 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:02.269577 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-1517b7e2-10a1-4e20-9d82-ee471ef173a8 req-b4d81aff-175a-4c63-8564-d0ff8451f952 service nova] Creating event network-vif-unplugged:f631937a-090e-4c88-959c-bbf9308dfac9 for instance 078668ec-0695-4717-bef7-1153cdc2dd14 on hv-cinder-81899 Apr 05 11:24:02.275256 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-1517b7e2-10a1-4e20-9d82-ee471ef173a8 req-b4d81aff-175a-4c63-8564-d0ff8451f952 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031981 Apr 05 11:24:02.275854 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 618/1217] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:24:02.365122 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-42bef67a-76ca-4546-99f0-6cc5ddd70292 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:02.366099 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-42bef67a-76ca-4546-99f0-6cc5ddd70292 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:02.372496 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42bef67a-76ca-4546-99f0-6cc5ddd70292 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:02.372948 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42bef67a-76ca-4546-99f0-6cc5ddd70292 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:02.373726 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42bef67a-76ca-4546-99f0-6cc5ddd70292 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:02.374160 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42bef67a-76ca-4546-99f0-6cc5ddd70292 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:02.404887 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-42bef67a-76ca-4546-99f0-6cc5ddd70292 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043817 Apr 05 11:24:02.405488 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 600/1218] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:24:02 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:24:02.441071 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-94eedc2c-2b29-4551-b9d2-ed5795388ab0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:02.441760 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-94eedc2c-2b29-4551-b9d2-ed5795388ab0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:02.448977 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-94eedc2c-2b29-4551-b9d2-ed5795388ab0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:02.449423 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-94eedc2c-2b29-4551-b9d2-ed5795388ab0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:02.450184 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-94eedc2c-2b29-4551-b9d2-ed5795388ab0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:02.450643 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-94eedc2c-2b29-4551-b9d2-ed5795388ab0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:02.562632 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9c68b483-4459-4555-8859-21922a5095d9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:02.563241 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9c68b483-4459-4555-8859-21922a5095d9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:02.570330 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c68b483-4459-4555-8859-21922a5095d9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:02.572636 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c68b483-4459-4555-8859-21922a5095d9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:02.572636 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c68b483-4459-4555-8859-21922a5095d9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:02.572636 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9c68b483-4459-4555-8859-21922a5095d9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:02.599789 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-94eedc2c-2b29-4551-b9d2-ed5795388ab0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:02.602871 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9c68b483-4459-4555-8859-21922a5095d9 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments/e7140214-fd39-4be8-bbb8-da2f7e8506f5" status: 200 len: 194 microversion: 2.1 time: 0.044401 Apr 05 11:24:02.603498 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 601/1219] 10.222.0.39 () {58 vars in 1412 bytes} [Tue Apr 5 11:24:02 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments/e7140214-fd39-4be8-bbb8-da2f7e8506f5 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:24:02.609504 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-94eedc2c-2b29-4551-b9d2-ed5795388ab0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:02.610220 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-94eedc2c-2b29-4551-b9d2-ed5795388ab0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:02.611494 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-94eedc2c-2b29-4551-b9d2-ed5795388ab0 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1721 microversion: 2.20 time: 0.174701 Apr 05 11:24:02.612109 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 619/1220] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:02 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:02.613870 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fabc1d56-29e0-4331-bf16-b17b6ae233be tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:02.614372 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fabc1d56-29e0-4331-bf16-b17b6ae233be tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:02.621427 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fabc1d56-29e0-4331-bf16-b17b6ae233be tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:02.621869 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fabc1d56-29e0-4331-bf16-b17b6ae233be tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:02.622688 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fabc1d56-29e0-4331-bf16-b17b6ae233be tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:02.623128 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fabc1d56-29e0-4331-bf16-b17b6ae233be tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:02.709685 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-fabc1d56-29e0-4331-bf16-b17b6ae233be tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lazy-loading 'services' on Instance uuid f5ad1a46-8a77-4def-b880-e32ca5f36db1 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:24:03.019312 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fabc1d56-29e0-4331-bf16-b17b6ae233be tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments/e7140214-fd39-4be8-bbb8-da2f7e8506f5" status: 202 len: 0 microversion: 2.1 time: 0.409367 Apr 05 11:24:03.019914 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 602/1221] 10.222.0.39 () {58 vars in 1415 bytes} [Tue Apr 5 11:24:02 2022] DELETE /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments/e7140214-fd39-4be8-bbb8-da2f7e8506f5 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:24:03.630196 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a8baa5d9-2b53-4721-a98a-c8d1224c33ef tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:03.630758 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a8baa5d9-2b53-4721-a98a-c8d1224c33ef tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:03.637059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a8baa5d9-2b53-4721-a98a-c8d1224c33ef tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:03.637501 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a8baa5d9-2b53-4721-a98a-c8d1224c33ef tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:03.638257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a8baa5d9-2b53-4721-a98a-c8d1224c33ef tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:03.638716 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a8baa5d9-2b53-4721-a98a-c8d1224c33ef tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:03.770743 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a8baa5d9-2b53-4721-a98a-c8d1224c33ef tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:03.778525 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a8baa5d9-2b53-4721-a98a-c8d1224c33ef tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:03.780074 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a8baa5d9-2b53-4721-a98a-c8d1224c33ef tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:03.781214 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a8baa5d9-2b53-4721-a98a-c8d1224c33ef tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1721 microversion: 2.20 time: 0.155096 Apr 05 11:24:03.781777 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 620/1222] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:03 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:04.800804 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dfdce360-25c8-4b1c-ba4b-8f0450529f4d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:04.801487 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dfdce360-25c8-4b1c-ba4b-8f0450529f4d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:04.808247 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dfdce360-25c8-4b1c-ba4b-8f0450529f4d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:04.808697 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dfdce360-25c8-4b1c-ba4b-8f0450529f4d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:04.809454 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dfdce360-25c8-4b1c-ba4b-8f0450529f4d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:04.809889 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dfdce360-25c8-4b1c-ba4b-8f0450529f4d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:04.946016 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dfdce360-25c8-4b1c-ba4b-8f0450529f4d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:04.953778 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dfdce360-25c8-4b1c-ba4b-8f0450529f4d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:04.955311 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dfdce360-25c8-4b1c-ba4b-8f0450529f4d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:04.956482 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dfdce360-25c8-4b1c-ba4b-8f0450529f4d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1721 microversion: 2.20 time: 0.160369 Apr 05 11:24:04.957080 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 603/1223] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:04 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:05.975384 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dbf6ea32-b78e-462d-ad09-0dd21e6ced4c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:05.975969 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dbf6ea32-b78e-462d-ad09-0dd21e6ced4c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:05.982261 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dbf6ea32-b78e-462d-ad09-0dd21e6ced4c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:05.982741 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dbf6ea32-b78e-462d-ad09-0dd21e6ced4c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:05.983759 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dbf6ea32-b78e-462d-ad09-0dd21e6ced4c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:05.984186 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dbf6ea32-b78e-462d-ad09-0dd21e6ced4c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:06.125403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-dbf6ea32-b78e-462d-ad09-0dd21e6ced4c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:06.133371 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-dbf6ea32-b78e-462d-ad09-0dd21e6ced4c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:06.134901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-dbf6ea32-b78e-462d-ad09-0dd21e6ced4c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:06.136048 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dbf6ea32-b78e-462d-ad09-0dd21e6ced4c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1721 microversion: 2.20 time: 0.165205 Apr 05 11:24:06.136613 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 621/1224] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:05 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:07.153492 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-36386402-a369-43a2-9cb2-79dc0812bdff tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:07.154635 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-36386402-a369-43a2-9cb2-79dc0812bdff tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:07.161506 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36386402-a369-43a2-9cb2-79dc0812bdff tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:07.161958 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36386402-a369-43a2-9cb2-79dc0812bdff tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:07.162780 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36386402-a369-43a2-9cb2-79dc0812bdff tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:07.163216 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36386402-a369-43a2-9cb2-79dc0812bdff tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:07.307304 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-36386402-a369-43a2-9cb2-79dc0812bdff tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:07.315117 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-36386402-a369-43a2-9cb2-79dc0812bdff tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:07.316615 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-36386402-a369-43a2-9cb2-79dc0812bdff tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:07.317759 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-36386402-a369-43a2-9cb2-79dc0812bdff tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1721 microversion: 2.20 time: 0.168278 Apr 05 11:24:07.318316 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 604/1225] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:07 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:08.335692 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e69eb30d-2c62-4009-8090-83b33977cde8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:08.336394 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e69eb30d-2c62-4009-8090-83b33977cde8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:08.342644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e69eb30d-2c62-4009-8090-83b33977cde8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:08.343105 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e69eb30d-2c62-4009-8090-83b33977cde8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:08.344513 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e69eb30d-2c62-4009-8090-83b33977cde8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:08.344646 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e69eb30d-2c62-4009-8090-83b33977cde8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:08.490182 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e69eb30d-2c62-4009-8090-83b33977cde8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:08.499872 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e69eb30d-2c62-4009-8090-83b33977cde8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:08.501401 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e69eb30d-2c62-4009-8090-83b33977cde8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:08.502659 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e69eb30d-2c62-4009-8090-83b33977cde8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1724 microversion: 2.20 time: 0.171437 Apr 05 11:24:08.503244 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 622/1226] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:08 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:24:08.521878 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d9620f4c-b8fb-44b9-aae6-991bc9f6ebab tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b0ef767-1b3d-437b-8789-9997631b57b9"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:24:08.523065 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d9620f4c-b8fb-44b9-aae6-991bc9f6ebab tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:08.529993 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d9620f4c-b8fb-44b9-aae6-991bc9f6ebab tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:08.530447 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d9620f4c-b8fb-44b9-aae6-991bc9f6ebab tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:08.531345 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d9620f4c-b8fb-44b9-aae6-991bc9f6ebab tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:08.531814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d9620f4c-b8fb-44b9-aae6-991bc9f6ebab tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:09.423273 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3311ff9a-de59-43f0-94c0-7ce62d61c8ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:09.424161 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3311ff9a-de59-43f0-94c0-7ce62d61c8ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:09.430713 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3311ff9a-de59-43f0-94c0-7ce62d61c8ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:09.439368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3311ff9a-de59-43f0-94c0-7ce62d61c8ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:09.439368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3311ff9a-de59-43f0-94c0-7ce62d61c8ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:09.439368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3311ff9a-de59-43f0-94c0-7ce62d61c8ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:09.460046 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3311ff9a-de59-43f0-94c0-7ce62d61c8ab tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments/b308b340-aec4-4f6f-9051-b5a2bf78eb37" status: 200 len: 194 microversion: 2.1 time: 0.040288 Apr 05 11:24:09.460635 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 623/1227] 10.222.0.39 () {58 vars in 1412 bytes} [Tue Apr 5 11:24:09 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments/b308b340-aec4-4f6f-9051-b5a2bf78eb37 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:24:09.470572 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f2b01453-350a-4ef5-af04-911f250cca5e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:09.471106 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f2b01453-350a-4ef5-af04-911f250cca5e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:09.477373 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f2b01453-350a-4ef5-af04-911f250cca5e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:09.477830 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f2b01453-350a-4ef5-af04-911f250cca5e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:09.478601 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f2b01453-350a-4ef5-af04-911f250cca5e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:09.479069 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f2b01453-350a-4ef5-af04-911f250cca5e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:09.557400 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-f2b01453-350a-4ef5-af04-911f250cca5e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lazy-loading 'services' on Instance uuid f5ad1a46-8a77-4def-b880-e32ca5f36db1 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:24:10.052771 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f2b01453-350a-4ef5-af04-911f250cca5e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments/b308b340-aec4-4f6f-9051-b5a2bf78eb37" status: 202 len: 0 microversion: 2.1 time: 0.585667 Apr 05 11:24:10.053866 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 624/1228] 10.222.0.39 () {58 vars in 1415 bytes} [Tue Apr 5 11:24:09 2022] DELETE /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments/b308b340-aec4-4f6f-9051-b5a2bf78eb37 => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:24:10.059609 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-130bc11a-0ea7-41b9-bdbe-92197fbfb8a0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:10.063424 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-130bc11a-0ea7-41b9-bdbe-92197fbfb8a0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:10.066453 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-130bc11a-0ea7-41b9-bdbe-92197fbfb8a0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:10.066946 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-130bc11a-0ea7-41b9-bdbe-92197fbfb8a0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:10.067733 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-130bc11a-0ea7-41b9-bdbe-92197fbfb8a0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:10.068170 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-130bc11a-0ea7-41b9-bdbe-92197fbfb8a0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:10.092441 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-130bc11a-0ea7-41b9-bdbe-92197fbfb8a0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:24:10.224465 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d9620f4c-b8fb-44b9-aae6-991bc9f6ebab tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "POST /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.706671 Apr 05 11:24:10.229615 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 605/1229] 10.222.0.39 () {62 vars in 1363 bytes} [Tue Apr 5 11:24:08 2022] POST /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/os-volume_attachments => generated 188 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:24:10.377653 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dd6b528e-d60f-479b-9051-bffa311cdbad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:10.378157 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dd6b528e-d60f-479b-9051-bffa311cdbad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:10.384079 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dd6b528e-d60f-479b-9051-bffa311cdbad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:10.386290 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dd6b528e-d60f-479b-9051-bffa311cdbad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:10.386290 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dd6b528e-d60f-479b-9051-bffa311cdbad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:10.386290 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dd6b528e-d60f-479b-9051-bffa311cdbad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:10.448523 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-130bc11a-0ea7-41b9-bdbe-92197fbfb8a0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 204 len: 0 microversion: 2.1 time: 0.392302 Apr 05 11:24:10.448984 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 625/1230] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:24:10 2022] DELETE /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:24:10.456954 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2b499e6f-ff15-4594-bb09-95a902aae299 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:10.457661 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2b499e6f-ff15-4594-bb09-95a902aae299 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:10.463793 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b499e6f-ff15-4594-bb09-95a902aae299 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:10.464256 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b499e6f-ff15-4594-bb09-95a902aae299 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:10.465040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b499e6f-ff15-4594-bb09-95a902aae299 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:10.465484 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b499e6f-ff15-4594-bb09-95a902aae299 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:10.601953 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2b499e6f-ff15-4594-bb09-95a902aae299 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:10.609817 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2b499e6f-ff15-4594-bb09-95a902aae299 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1577 microversion: 2.1 time: 0.157048 Apr 05 11:24:10.610410 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 626/1231] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:10 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:11.081655 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dd6b528e-d60f-479b-9051-bffa311cdbad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/os-volume_attachments/5b0ef767-1b3d-437b-8789-9997631b57b9" status: 202 len: 0 microversion: 2.20 time: 0.707850 Apr 05 11:24:11.082296 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 606/1232] 10.222.0.39 () {60 vars in 1456 bytes} [Tue Apr 5 11:24:10 2022] DELETE /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/os-volume_attachments/5b0ef767-1b3d-437b-8789-9997631b57b9 => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 05 11:24:11.138503 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-be12adbe-10c0-4672-bf48-94706d184872 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:24:11.139110 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-be12adbe-10c0-4672-bf48-94706d184872 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:11.145121 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be12adbe-10c0-4672-bf48-94706d184872 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:11.145580 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be12adbe-10c0-4672-bf48-94706d184872 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:11.146358 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be12adbe-10c0-4672-bf48-94706d184872 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:11.146839 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be12adbe-10c0-4672-bf48-94706d184872 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:11.404267 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-be12adbe-10c0-4672-bf48-94706d184872 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "POST /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/action" status: 202 len: 0 microversion: 2.20 time: 0.269672 Apr 05 11:24:11.404904 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 627/1233] 10.222.0.39 () {62 vars in 1318 bytes} [Tue Apr 5 11:24:11 2022] POST /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:24:11.414058 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d0e8ce69-dc9a-447a-a4e6-cfdfa72a0d3a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:11.418933 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d0e8ce69-dc9a-447a-a4e6-cfdfa72a0d3a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:11.422541 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d0e8ce69-dc9a-447a-a4e6-cfdfa72a0d3a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:11.423165 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d0e8ce69-dc9a-447a-a4e6-cfdfa72a0d3a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:11.424070 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d0e8ce69-dc9a-447a-a4e6-cfdfa72a0d3a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:11.424521 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d0e8ce69-dc9a-447a-a4e6-cfdfa72a0d3a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:11.583499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d0e8ce69-dc9a-447a-a4e6-cfdfa72a0d3a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:11.598337 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d0e8ce69-dc9a-447a-a4e6-cfdfa72a0d3a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:11.601687 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d0e8ce69-dc9a-447a-a4e6-cfdfa72a0d3a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:11.603695 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d0e8ce69-dc9a-447a-a4e6-cfdfa72a0d3a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1672 microversion: 2.20 time: 0.193983 Apr 05 11:24:11.604599 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 607/1234] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:11 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1672 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:24:11.628423 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d371a23c-ace7-4664-a861-5649eeb648e9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:11.629037 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d371a23c-ace7-4664-a861-5649eeb648e9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:11.635361 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d371a23c-ace7-4664-a861-5649eeb648e9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:11.636048 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d371a23c-ace7-4664-a861-5649eeb648e9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:11.636825 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d371a23c-ace7-4664-a861-5649eeb648e9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:11.637265 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d371a23c-ace7-4664-a861-5649eeb648e9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:11.784054 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d371a23c-ace7-4664-a861-5649eeb648e9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:11.792019 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d371a23c-ace7-4664-a861-5649eeb648e9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1577 microversion: 2.1 time: 0.168010 Apr 05 11:24:11.792787 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 628/1235] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:11 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:12.623658 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-53ebb969-4de0-4e6c-9749-0a91b5c6739a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:12.624267 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-53ebb969-4de0-4e6c-9749-0a91b5c6739a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:12.630595 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53ebb969-4de0-4e6c-9749-0a91b5c6739a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:12.631572 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53ebb969-4de0-4e6c-9749-0a91b5c6739a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:12.632343 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53ebb969-4de0-4e6c-9749-0a91b5c6739a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:12.632867 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53ebb969-4de0-4e6c-9749-0a91b5c6739a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:12.766639 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-53ebb969-4de0-4e6c-9749-0a91b5c6739a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:12.774936 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-53ebb969-4de0-4e6c-9749-0a91b5c6739a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:12.776433 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-53ebb969-4de0-4e6c-9749-0a91b5c6739a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:12.777571 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-53ebb969-4de0-4e6c-9749-0a91b5c6739a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1672 microversion: 2.20 time: 0.157875 Apr 05 11:24:12.778126 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 608/1236] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:12 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:12.809148 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2271fb69-04de-4897-9065-27efe1947778 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:12.809788 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2271fb69-04de-4897-9065-27efe1947778 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:12.816293 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2271fb69-04de-4897-9065-27efe1947778 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:12.816794 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2271fb69-04de-4897-9065-27efe1947778 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:12.817573 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2271fb69-04de-4897-9065-27efe1947778 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:12.818041 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2271fb69-04de-4897-9065-27efe1947778 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:12.961625 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2271fb69-04de-4897-9065-27efe1947778 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:12.969718 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2271fb69-04de-4897-9065-27efe1947778 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1577 microversion: 2.1 time: 0.164318 Apr 05 11:24:12.970316 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 629/1237] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:12 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:13.795461 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e59f54fa-ecec-41d3-8e70-b77ae96803ac tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:13.796173 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e59f54fa-ecec-41d3-8e70-b77ae96803ac tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:13.802624 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e59f54fa-ecec-41d3-8e70-b77ae96803ac tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:13.803089 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e59f54fa-ecec-41d3-8e70-b77ae96803ac tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:13.803864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e59f54fa-ecec-41d3-8e70-b77ae96803ac tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:13.804299 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e59f54fa-ecec-41d3-8e70-b77ae96803ac tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:13.947942 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e59f54fa-ecec-41d3-8e70-b77ae96803ac tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:13.956196 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e59f54fa-ecec-41d3-8e70-b77ae96803ac tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:13.957694 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e59f54fa-ecec-41d3-8e70-b77ae96803ac tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:13.958876 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e59f54fa-ecec-41d3-8e70-b77ae96803ac tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1672 microversion: 2.20 time: 0.167453 Apr 05 11:24:13.959929 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 609/1238] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:13 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:13.987395 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-808e9ff9-2b94-49ca-ad7e-13ebbac81bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:13.988028 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-808e9ff9-2b94-49ca-ad7e-13ebbac81bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:13.994487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-808e9ff9-2b94-49ca-ad7e-13ebbac81bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:13.994968 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-808e9ff9-2b94-49ca-ad7e-13ebbac81bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:13.995741 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-808e9ff9-2b94-49ca-ad7e-13ebbac81bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:13.996172 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-808e9ff9-2b94-49ca-ad7e-13ebbac81bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:14.137189 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-808e9ff9-2b94-49ca-ad7e-13ebbac81bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:14.144888 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-808e9ff9-2b94-49ca-ad7e-13ebbac81bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1577 microversion: 2.1 time: 0.161594 Apr 05 11:24:14.145478 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 630/1239] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:13 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:14.978098 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-19337511-49e7-4226-92c6-15c5b0c9e609 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:14.978878 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-19337511-49e7-4226-92c6-15c5b0c9e609 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:14.985494 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-19337511-49e7-4226-92c6-15c5b0c9e609 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:14.985955 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-19337511-49e7-4226-92c6-15c5b0c9e609 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:14.986800 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-19337511-49e7-4226-92c6-15c5b0c9e609 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:14.987251 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-19337511-49e7-4226-92c6-15c5b0c9e609 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:15.135319 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-19337511-49e7-4226-92c6-15c5b0c9e609 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:15.143626 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-19337511-49e7-4226-92c6-15c5b0c9e609 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:15.145038 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-19337511-49e7-4226-92c6-15c5b0c9e609 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:15.146192 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-19337511-49e7-4226-92c6-15c5b0c9e609 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1672 microversion: 2.20 time: 0.172749 Apr 05 11:24:15.146784 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 610/1240] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:14 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:24:15.164025 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-140e811a-bb07-40f3-8e70-46bec9ef5d83 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:15.164639 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-140e811a-bb07-40f3-8e70-46bec9ef5d83 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:15.171257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-140e811a-bb07-40f3-8e70-46bec9ef5d83 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:15.171707 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-140e811a-bb07-40f3-8e70-46bec9ef5d83 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:15.172513 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-140e811a-bb07-40f3-8e70-46bec9ef5d83 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:15.172972 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-140e811a-bb07-40f3-8e70-46bec9ef5d83 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:15.323768 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-140e811a-bb07-40f3-8e70-46bec9ef5d83 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:15.331331 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-140e811a-bb07-40f3-8e70-46bec9ef5d83 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1577 microversion: 2.1 time: 0.171686 Apr 05 11:24:15.331915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 631/1241] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:15 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:16.164451 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-174b41c5-8310-46d6-9b73-d2d4f425553b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:16.165020 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-174b41c5-8310-46d6-9b73-d2d4f425553b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:16.171662 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-174b41c5-8310-46d6-9b73-d2d4f425553b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:16.172203 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-174b41c5-8310-46d6-9b73-d2d4f425553b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:16.172761 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-174b41c5-8310-46d6-9b73-d2d4f425553b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:16.173222 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-174b41c5-8310-46d6-9b73-d2d4f425553b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:16.312584 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-174b41c5-8310-46d6-9b73-d2d4f425553b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:16.320700 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-174b41c5-8310-46d6-9b73-d2d4f425553b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:16.322245 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-174b41c5-8310-46d6-9b73-d2d4f425553b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:16.323445 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-174b41c5-8310-46d6-9b73-d2d4f425553b tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.162917 Apr 05 11:24:16.324011 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 611/1242] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:16 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:16.349041 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-150ee79b-171f-427d-8378-9ffea8aadb4a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:16.350179 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-150ee79b-171f-427d-8378-9ffea8aadb4a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:16.356701 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-150ee79b-171f-427d-8378-9ffea8aadb4a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:16.357157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-150ee79b-171f-427d-8378-9ffea8aadb4a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:16.357931 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-150ee79b-171f-427d-8378-9ffea8aadb4a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:16.358718 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-150ee79b-171f-427d-8378-9ffea8aadb4a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:16.508935 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-150ee79b-171f-427d-8378-9ffea8aadb4a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:16.517796 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-150ee79b-171f-427d-8378-9ffea8aadb4a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1577 microversion: 2.1 time: 0.172617 Apr 05 11:24:16.518748 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 632/1243] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:16 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:16.565651 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c25a7d77-ecbd-4396-9987-2463b91fd9de tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:16.566677 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c25a7d77-ecbd-4396-9987-2463b91fd9de tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:16.575844 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c25a7d77-ecbd-4396-9987-2463b91fd9de tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:16.576587 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c25a7d77-ecbd-4396-9987-2463b91fd9de tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:16.577642 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c25a7d77-ecbd-4396-9987-2463b91fd9de tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:16.578988 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c25a7d77-ecbd-4396-9987-2463b91fd9de tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:16.610094 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c25a7d77-ecbd-4396-9987-2463b91fd9de tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048441 Apr 05 11:24:16.611020 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 612/1244] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:24:16 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:24:16.732821 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0ad2cf29-d9c6-4b06-8e47-4296dea7658c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:16.734077 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0ad2cf29-d9c6-4b06-8e47-4296dea7658c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:16.740467 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ad2cf29-d9c6-4b06-8e47-4296dea7658c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:16.740943 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ad2cf29-d9c6-4b06-8e47-4296dea7658c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:16.742144 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ad2cf29-d9c6-4b06-8e47-4296dea7658c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:16.742865 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ad2cf29-d9c6-4b06-8e47-4296dea7658c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:16.786629 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0ad2cf29-d9c6-4b06-8e47-4296dea7658c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059107 Apr 05 11:24:16.787826 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 633/1245] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:24:16 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:24:16.866547 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1d2b63d5-cac9-41bc-89a1-446c296d1815 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:16.867385 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1d2b63d5-cac9-41bc-89a1-446c296d1815 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:16.873528 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d2b63d5-cac9-41bc-89a1-446c296d1815 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:16.874286 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d2b63d5-cac9-41bc-89a1-446c296d1815 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:16.874791 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d2b63d5-cac9-41bc-89a1-446c296d1815 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:16.875241 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d2b63d5-cac9-41bc-89a1-446c296d1815 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:16.901015 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1d2b63d5-cac9-41bc-89a1-446c296d1815 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:24:17.265164 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1d2b63d5-cac9-41bc-89a1-446c296d1815 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 204 len: 0 microversion: 2.1 time: 0.402227 Apr 05 11:24:17.268905 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 613/1246] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:24:16 2022] DELETE /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:24:17.274089 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9dbbec2e-a2f8-4a68-9ba2-f846bb66d41a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:17.274865 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9dbbec2e-a2f8-4a68-9ba2-f846bb66d41a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:17.285678 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9dbbec2e-a2f8-4a68-9ba2-f846bb66d41a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:17.285678 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9dbbec2e-a2f8-4a68-9ba2-f846bb66d41a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:17.286028 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9dbbec2e-a2f8-4a68-9ba2-f846bb66d41a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:17.287660 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9dbbec2e-a2f8-4a68-9ba2-f846bb66d41a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:17.343495 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3c8f26c2-96ff-4db0-9bf3-6e3af37672dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:17.344218 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3c8f26c2-96ff-4db0-9bf3-6e3af37672dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:17.364317 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3c8f26c2-96ff-4db0-9bf3-6e3af37672dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:17.364751 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3c8f26c2-96ff-4db0-9bf3-6e3af37672dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:17.366087 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3c8f26c2-96ff-4db0-9bf3-6e3af37672dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:17.366529 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3c8f26c2-96ff-4db0-9bf3-6e3af37672dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:17.479499 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9dbbec2e-a2f8-4a68-9ba2-f846bb66d41a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:17.487792 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9dbbec2e-a2f8-4a68-9ba2-f846bb66d41a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.217542 Apr 05 11:24:17.488370 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 634/1247] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:17 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:17.535605 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0ba3ba88-806b-4ed9-8981-736a0eb3dac8 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:17.536266 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0ba3ba88-806b-4ed9-8981-736a0eb3dac8 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:17.543008 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ba3ba88-806b-4ed9-8981-736a0eb3dac8 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:17.543467 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ba3ba88-806b-4ed9-8981-736a0eb3dac8 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:17.544251 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ba3ba88-806b-4ed9-8981-736a0eb3dac8 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:17.544691 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ba3ba88-806b-4ed9-8981-736a0eb3dac8 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:17.545329 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3c8f26c2-96ff-4db0-9bf3-6e3af37672dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:17.554167 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3c8f26c2-96ff-4db0-9bf3-6e3af37672dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:17.556130 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3c8f26c2-96ff-4db0-9bf3-6e3af37672dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:17.557597 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3c8f26c2-96ff-4db0-9bf3-6e3af37672dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.218818 Apr 05 11:24:17.558600 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 614/1248] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:17 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:24:17.611554 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0ba3ba88-806b-4ed9-8981-736a0eb3dac8 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:17.619261 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0ba3ba88-806b-4ed9-8981-736a0eb3dac8 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1510 microversion: 2.1 time: 0.087564 Apr 05 11:24:17.619843 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 635/1249] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:17 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1510 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:17.889887 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-00e17a66-2c63-4192-8a0a-196ab267ae9e req-020524a1-0ce5-4773-b752-037d5f53cd42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af2a30d-f115-44a9-9a90-d1699560bd75", "name": "network-vif-deleted", "tag": "636d7202-7eb2-4976-9af9-7eb3c2e5f3e2"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:24:17.898944 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-00e17a66-2c63-4192-8a0a-196ab267ae9e req-020524a1-0ce5-4773-b752-037d5f53cd42 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:17.899390 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-00e17a66-2c63-4192-8a0a-196ab267ae9e req-020524a1-0ce5-4773-b752-037d5f53cd42 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:17.910678 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-00e17a66-2c63-4192-8a0a-196ab267ae9e req-020524a1-0ce5-4773-b752-037d5f53cd42 service nova] Creating event network-vif-deleted:636d7202-7eb2-4976-9af9-7eb3c2e5f3e2 for instance 1af2a30d-f115-44a9-9a90-d1699560bd75 on hv-cinder-81899 Apr 05 11:24:17.915906 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-00e17a66-2c63-4192-8a0a-196ab267ae9e req-020524a1-0ce5-4773-b752-037d5f53cd42 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029647 Apr 05 11:24:17.916777 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 615/1250] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:24:18.504190 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-97284855-2d6d-4c51-9bee-952a16c2dadf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:18.504928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-97284855-2d6d-4c51-9bee-952a16c2dadf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:18.512306 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97284855-2d6d-4c51-9bee-952a16c2dadf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:18.512746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97284855-2d6d-4c51-9bee-952a16c2dadf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:18.513522 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97284855-2d6d-4c51-9bee-952a16c2dadf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:18.514046 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97284855-2d6d-4c51-9bee-952a16c2dadf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:18.577071 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c993c4b1-ef71-4536-b04a-e1420dd191c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:18.577835 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c993c4b1-ef71-4536-b04a-e1420dd191c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:18.585201 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c993c4b1-ef71-4536-b04a-e1420dd191c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:18.585962 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c993c4b1-ef71-4536-b04a-e1420dd191c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:18.586820 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c993c4b1-ef71-4536-b04a-e1420dd191c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:18.587437 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c993c4b1-ef71-4536-b04a-e1420dd191c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:18.673867 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-97284855-2d6d-4c51-9bee-952a16c2dadf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:18.694935 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-97284855-2d6d-4c51-9bee-952a16c2dadf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.194544 Apr 05 11:24:18.701903 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 636/1251] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:18 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:18.710825 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0f7a464f-0793-485d-a7f6-22667db74c20 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:18.711487 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0f7a464f-0793-485d-a7f6-22667db74c20 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:18.718295 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0f7a464f-0793-485d-a7f6-22667db74c20 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:18.718770 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0f7a464f-0793-485d-a7f6-22667db74c20 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:18.719860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0f7a464f-0793-485d-a7f6-22667db74c20 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:18.720342 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0f7a464f-0793-485d-a7f6-22667db74c20 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:18.761197 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c993c4b1-ef71-4536-b04a-e1420dd191c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:18.771414 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c993c4b1-ef71-4536-b04a-e1420dd191c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:18.773067 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c993c4b1-ef71-4536-b04a-e1420dd191c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:18.775147 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c993c4b1-ef71-4536-b04a-e1420dd191c7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.201931 Apr 05 11:24:18.776088 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 616/1252] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:18 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:24:18.806883 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0f7a464f-0793-485d-a7f6-22667db74c20 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:18.815940 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0f7a464f-0793-485d-a7f6-22667db74c20 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1510 microversion: 2.1 time: 0.112050 Apr 05 11:24:18.816631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 637/1253] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:18 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1510 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:19.712767 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-39120e38-c7cf-404a-bfa7-af9817bf6ace tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:19.713447 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-39120e38-c7cf-404a-bfa7-af9817bf6ace tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:19.720433 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39120e38-c7cf-404a-bfa7-af9817bf6ace tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:19.720812 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39120e38-c7cf-404a-bfa7-af9817bf6ace tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:19.721607 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39120e38-c7cf-404a-bfa7-af9817bf6ace tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:19.722077 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39120e38-c7cf-404a-bfa7-af9817bf6ace tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:19.795898 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4ea2baad-e2a7-406f-8451-3fdbc9f230ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:19.797241 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4ea2baad-e2a7-406f-8451-3fdbc9f230ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:19.806964 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ea2baad-e2a7-406f-8451-3fdbc9f230ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:19.807794 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ea2baad-e2a7-406f-8451-3fdbc9f230ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:19.808925 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ea2baad-e2a7-406f-8451-3fdbc9f230ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:19.809655 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ea2baad-e2a7-406f-8451-3fdbc9f230ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:19.876096 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-39120e38-c7cf-404a-bfa7-af9817bf6ace tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:19.884618 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-39120e38-c7cf-404a-bfa7-af9817bf6ace tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.175693 Apr 05 11:24:19.885307 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 617/1254] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:19 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:19.895031 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-575d9c23-7d9a-42a6-99c6-b871ffdd1782 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:19.900798 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-575d9c23-7d9a-42a6-99c6-b871ffdd1782 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:19.901982 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-575d9c23-7d9a-42a6-99c6-b871ffdd1782 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:19.902690 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-575d9c23-7d9a-42a6-99c6-b871ffdd1782 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:19.903385 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-575d9c23-7d9a-42a6-99c6-b871ffdd1782 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:19.903825 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-575d9c23-7d9a-42a6-99c6-b871ffdd1782 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:19.967257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4ea2baad-e2a7-406f-8451-3fdbc9f230ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:19.968051 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-575d9c23-7d9a-42a6-99c6-b871ffdd1782 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:19.979422 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4ea2baad-e2a7-406f-8451-3fdbc9f230ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:19.979651 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-575d9c23-7d9a-42a6-99c6-b871ffdd1782 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.085522 Apr 05 11:24:19.979651 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 618/1255] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:19 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:19.979830 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4ea2baad-e2a7-406f-8451-3fdbc9f230ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:19.979830 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4ea2baad-e2a7-406f-8451-3fdbc9f230ad tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.188805 Apr 05 11:24:19.980131 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 638/1256] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:19 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:24:20.903081 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-70f2e65b-5589-495a-adf4-77a661ac9740 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:20.904471 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-70f2e65b-5589-495a-adf4-77a661ac9740 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:20.914660 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-70f2e65b-5589-495a-adf4-77a661ac9740 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:20.915302 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-70f2e65b-5589-495a-adf4-77a661ac9740 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:20.916580 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-70f2e65b-5589-495a-adf4-77a661ac9740 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:20.917310 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-70f2e65b-5589-495a-adf4-77a661ac9740 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:20.995940 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3b066989-3059-4d05-ac12-9aada76b0127 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:20.996662 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3b066989-3059-4d05-ac12-9aada76b0127 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:21.004054 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b066989-3059-4d05-ac12-9aada76b0127 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:21.004886 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b066989-3059-4d05-ac12-9aada76b0127 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:21.006286 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b066989-3059-4d05-ac12-9aada76b0127 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:21.006877 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b066989-3059-4d05-ac12-9aada76b0127 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:21.067347 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-70f2e65b-5589-495a-adf4-77a661ac9740 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:21.076421 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-70f2e65b-5589-495a-adf4-77a661ac9740 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.178266 Apr 05 11:24:21.077017 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 619/1257] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:20 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:21.077224 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3b066989-3059-4d05-ac12-9aada76b0127 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:21.082184 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-89a8dc82-0fcf-49eb-bb78-3d9a19ea4cae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:21.082854 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-89a8dc82-0fcf-49eb-bb78-3d9a19ea4cae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:21.087101 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3b066989-3059-4d05-ac12-9aada76b0127 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.097321 Apr 05 11:24:21.087811 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 639/1258] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:20 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:21.093183 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89a8dc82-0fcf-49eb-bb78-3d9a19ea4cae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:21.093745 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89a8dc82-0fcf-49eb-bb78-3d9a19ea4cae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:21.094697 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89a8dc82-0fcf-49eb-bb78-3d9a19ea4cae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:21.095281 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89a8dc82-0fcf-49eb-bb78-3d9a19ea4cae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:21.234574 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-89a8dc82-0fcf-49eb-bb78-3d9a19ea4cae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:21.243374 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-89a8dc82-0fcf-49eb-bb78-3d9a19ea4cae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:21.244987 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-89a8dc82-0fcf-49eb-bb78-3d9a19ea4cae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:21.246129 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-89a8dc82-0fcf-49eb-bb78-3d9a19ea4cae tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.167824 Apr 05 11:24:21.246735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 620/1259] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:21 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:22.057388 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d3060279-c908-48f6-a88c-d30aeba4c594 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:22.057901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d3060279-c908-48f6-a88c-d30aeba4c594 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:22.081536 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3060279-c908-48f6-a88c-d30aeba4c594 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:22.082001 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3060279-c908-48f6-a88c-d30aeba4c594 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:22.082862 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3060279-c908-48f6-a88c-d30aeba4c594 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:22.083296 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3060279-c908-48f6-a88c-d30aeba4c594 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:22.128071 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d3060279-c908-48f6-a88c-d30aeba4c594 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:24:22.215975 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-056e09e9-d10a-49d5-9d24-993394237c84 req-8a32838d-f053-448f-89c2-7aa376702050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4e16432-3df3-4325-b757-906fbbeca604", "tag": "dc377578-0184-4a80-88e0-2385eab5c0c4"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:24:22.244288 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-056e09e9-d10a-49d5-9d24-993394237c84 req-8a32838d-f053-448f-89c2-7aa376702050 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:22.249110 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-056e09e9-d10a-49d5-9d24-993394237c84 req-8a32838d-f053-448f-89c2-7aa376702050 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:22.271019 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-056e09e9-d10a-49d5-9d24-993394237c84 req-8a32838d-f053-448f-89c2-7aa376702050 service nova] Creating event network-changed:dc377578-0184-4a80-88e0-2385eab5c0c4 for instance e4e16432-3df3-4325-b757-906fbbeca604 on hv-cinder-81899 Apr 05 11:24:22.289058 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-056e09e9-d10a-49d5-9d24-993394237c84 req-8a32838d-f053-448f-89c2-7aa376702050 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226559 Apr 05 11:24:22.289961 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 621/1260] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:24:22.295792 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c9410e53-f22e-4b4e-abc9-b4b31ae0df0f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:22.296306 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c9410e53-f22e-4b4e-abc9-b4b31ae0df0f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:22.319865 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9410e53-f22e-4b4e-abc9-b4b31ae0df0f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:22.321590 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9410e53-f22e-4b4e-abc9-b4b31ae0df0f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:22.323577 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9410e53-f22e-4b4e-abc9-b4b31ae0df0f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:22.331281 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9410e53-f22e-4b4e-abc9-b4b31ae0df0f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:22.581152 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c9410e53-f22e-4b4e-abc9-b4b31ae0df0f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:22.590216 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d3060279-c908-48f6-a88c-d30aeba4c594 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 204 len: 0 microversion: 2.1 time: 0.537175 Apr 05 11:24:22.602408 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 640/1261] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:24:22 2022] DELETE /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:24:22.602562 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c9410e53-f22e-4b4e-abc9-b4b31ae0df0f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.300874 Apr 05 11:24:22.602562 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 622/1262] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:22 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:22.602860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-507984b2-f5bc-4d1a-b895-8bbb4139e6d7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:22.602860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-507984b2-f5bc-4d1a-b895-8bbb4139e6d7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:22.609214 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-507984b2-f5bc-4d1a-b895-8bbb4139e6d7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:22.609506 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3cd45f7c-e85b-4a55-83cb-3deb31fb2fce tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:22.610229 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3cd45f7c-e85b-4a55-83cb-3deb31fb2fce tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:22.610496 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-507984b2-f5bc-4d1a-b895-8bbb4139e6d7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:22.611562 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-507984b2-f5bc-4d1a-b895-8bbb4139e6d7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:22.612223 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-507984b2-f5bc-4d1a-b895-8bbb4139e6d7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:22.616930 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3cd45f7c-e85b-4a55-83cb-3deb31fb2fce tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:22.617380 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3cd45f7c-e85b-4a55-83cb-3deb31fb2fce tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:22.618165 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3cd45f7c-e85b-4a55-83cb-3deb31fb2fce tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:22.618808 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3cd45f7c-e85b-4a55-83cb-3deb31fb2fce tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:22.699704 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-507984b2-f5bc-4d1a-b895-8bbb4139e6d7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:22.708820 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-507984b2-f5bc-4d1a-b895-8bbb4139e6d7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.116465 Apr 05 11:24:22.709760 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 641/1263] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:22 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:22.726581 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c70c7e9e-77d7-469a-bf4a-230ec71f2e6b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:22.728075 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c70c7e9e-77d7-469a-bf4a-230ec71f2e6b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:22.737843 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c70c7e9e-77d7-469a-bf4a-230ec71f2e6b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:22.738623 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c70c7e9e-77d7-469a-bf4a-230ec71f2e6b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:22.739644 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c70c7e9e-77d7-469a-bf4a-230ec71f2e6b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:22.740846 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c70c7e9e-77d7-469a-bf4a-230ec71f2e6b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:22.830099 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3cd45f7c-e85b-4a55-83cb-3deb31fb2fce tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:22.838778 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3cd45f7c-e85b-4a55-83cb-3deb31fb2fce tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:22.840378 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3cd45f7c-e85b-4a55-83cb-3deb31fb2fce tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:22.841766 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3cd45f7c-e85b-4a55-83cb-3deb31fb2fce tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.247803 Apr 05 11:24:22.842367 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 623/1264] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:22 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:22.901671 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c70c7e9e-77d7-469a-bf4a-230ec71f2e6b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:22.909877 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c70c7e9e-77d7-469a-bf4a-230ec71f2e6b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.198751 Apr 05 11:24:22.910459 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 642/1265] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:22 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:23.609614 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-155d1eee-cabb-4d3d-8a1f-f7fdffb211e1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:23.610207 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-155d1eee-cabb-4d3d-8a1f-f7fdffb211e1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:23.617550 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-155d1eee-cabb-4d3d-8a1f-f7fdffb211e1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:23.618005 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-155d1eee-cabb-4d3d-8a1f-f7fdffb211e1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:23.618830 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-155d1eee-cabb-4d3d-8a1f-f7fdffb211e1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:23.619271 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-155d1eee-cabb-4d3d-8a1f-f7fdffb211e1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:23.728676 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f5be7304-243f-44dd-8970-29fa786d2bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:23.729312 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f5be7304-243f-44dd-8970-29fa786d2bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:23.739172 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f5be7304-243f-44dd-8970-29fa786d2bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:23.739623 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f5be7304-243f-44dd-8970-29fa786d2bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:23.741190 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f5be7304-243f-44dd-8970-29fa786d2bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:23.741643 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f5be7304-243f-44dd-8970-29fa786d2bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:23.763003 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-155d1eee-cabb-4d3d-8a1f-f7fdffb211e1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:23.773494 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-155d1eee-cabb-4d3d-8a1f-f7fdffb211e1 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.167829 Apr 05 11:24:23.774098 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 624/1266] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:23 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:23.822050 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f5be7304-243f-44dd-8970-29fa786d2bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:23.829672 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f5be7304-243f-44dd-8970-29fa786d2bd6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.105087 Apr 05 11:24:23.830251 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 643/1267] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:23 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:23.860232 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-503f5473-121f-497c-b56b-c6506472675e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:23.860760 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-503f5473-121f-497c-b56b-c6506472675e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:23.867362 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-503f5473-121f-497c-b56b-c6506472675e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:23.867814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-503f5473-121f-497c-b56b-c6506472675e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:23.868588 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-503f5473-121f-497c-b56b-c6506472675e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:23.869025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-503f5473-121f-497c-b56b-c6506472675e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:23.929447 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-017d60b8-128d-4b8d-9e38-4950b3cb118a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:23.930176 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-017d60b8-128d-4b8d-9e38-4950b3cb118a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:23.936416 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-017d60b8-128d-4b8d-9e38-4950b3cb118a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:23.936875 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-017d60b8-128d-4b8d-9e38-4950b3cb118a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:23.937805 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-017d60b8-128d-4b8d-9e38-4950b3cb118a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:23.938242 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-017d60b8-128d-4b8d-9e38-4950b3cb118a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:24.011088 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-503f5473-121f-497c-b56b-c6506472675e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:24.019268 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-503f5473-121f-497c-b56b-c6506472675e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:24.020885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-503f5473-121f-497c-b56b-c6506472675e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:24.022790 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-503f5473-121f-497c-b56b-c6506472675e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.166113 Apr 05 11:24:24.022790 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 625/1268] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:23 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:24.081066 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-017d60b8-128d-4b8d-9e38-4950b3cb118a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:24.088647 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-017d60b8-128d-4b8d-9e38-4950b3cb118a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.163737 Apr 05 11:24:24.089227 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 644/1269] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:23 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:24.790703 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ab370758-36c6-4f95-9e7c-4edd0917eedd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:24.791292 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ab370758-36c6-4f95-9e7c-4edd0917eedd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:24.797254 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ab370758-36c6-4f95-9e7c-4edd0917eedd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:24.797705 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ab370758-36c6-4f95-9e7c-4edd0917eedd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:24.798476 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ab370758-36c6-4f95-9e7c-4edd0917eedd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:24.798974 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ab370758-36c6-4f95-9e7c-4edd0917eedd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:24.846425 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5c87d429-4e51-4d38-ad92-97a9f343831d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:24.847093 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5c87d429-4e51-4d38-ad92-97a9f343831d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:24.854158 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c87d429-4e51-4d38-ad92-97a9f343831d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:24.854652 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c87d429-4e51-4d38-ad92-97a9f343831d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:24.855433 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c87d429-4e51-4d38-ad92-97a9f343831d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:24.855865 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5c87d429-4e51-4d38-ad92-97a9f343831d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:24.917149 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5c87d429-4e51-4d38-ad92-97a9f343831d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:24.924693 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5c87d429-4e51-4d38-ad92-97a9f343831d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.082156 Apr 05 11:24:24.929945 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 645/1270] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:24 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:24.937114 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ab370758-36c6-4f95-9e7c-4edd0917eedd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:24.944720 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ab370758-36c6-4f95-9e7c-4edd0917eedd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.157895 Apr 05 11:24:24.945290 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 626/1271] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:24 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:25.041233 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-43bba7c7-e939-42ac-9882-95b84c5126bd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:25.041755 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-43bba7c7-e939-42ac-9882-95b84c5126bd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:25.047754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43bba7c7-e939-42ac-9882-95b84c5126bd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:25.048197 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43bba7c7-e939-42ac-9882-95b84c5126bd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:25.048959 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43bba7c7-e939-42ac-9882-95b84c5126bd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:25.049392 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43bba7c7-e939-42ac-9882-95b84c5126bd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:25.105873 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1d1e6f81-bd65-4c81-aaed-f0554b8b2a3b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:25.106626 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1d1e6f81-bd65-4c81-aaed-f0554b8b2a3b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:25.113090 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d1e6f81-bd65-4c81-aaed-f0554b8b2a3b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:25.113546 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d1e6f81-bd65-4c81-aaed-f0554b8b2a3b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:25.114337 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d1e6f81-bd65-4c81-aaed-f0554b8b2a3b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:25.114809 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d1e6f81-bd65-4c81-aaed-f0554b8b2a3b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:25.186096 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-43bba7c7-e939-42ac-9882-95b84c5126bd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:25.204287 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-43bba7c7-e939-42ac-9882-95b84c5126bd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:25.205951 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-43bba7c7-e939-42ac-9882-95b84c5126bd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:25.211283 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-43bba7c7-e939-42ac-9882-95b84c5126bd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.174677 Apr 05 11:24:25.225012 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 646/1272] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:25 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:25.267823 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1d1e6f81-bd65-4c81-aaed-f0554b8b2a3b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:25.277686 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1d1e6f81-bd65-4c81-aaed-f0554b8b2a3b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.175602 Apr 05 11:24:25.278506 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 627/1273] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:25 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:25.942036 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f78fa6bb-ce10-4f55-8b1a-b8d23f4e70ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:25.942640 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f78fa6bb-ce10-4f55-8b1a-b8d23f4e70ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:25.949653 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f78fa6bb-ce10-4f55-8b1a-b8d23f4e70ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:25.950096 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f78fa6bb-ce10-4f55-8b1a-b8d23f4e70ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:25.950887 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f78fa6bb-ce10-4f55-8b1a-b8d23f4e70ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:25.951322 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f78fa6bb-ce10-4f55-8b1a-b8d23f4e70ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:25.961292 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4cf11091-f123-4216-b7ef-940f8643e16b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:25.961903 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4cf11091-f123-4216-b7ef-940f8643e16b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:25.968611 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cf11091-f123-4216-b7ef-940f8643e16b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:25.969136 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cf11091-f123-4216-b7ef-940f8643e16b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:25.969869 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cf11091-f123-4216-b7ef-940f8643e16b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:25.970305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cf11091-f123-4216-b7ef-940f8643e16b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:26.030924 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f78fa6bb-ce10-4f55-8b1a-b8d23f4e70ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:26.052326 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f78fa6bb-ce10-4f55-8b1a-b8d23f4e70ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.113979 Apr 05 11:24:26.061903 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 647/1274] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:25 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:26.156068 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4cf11091-f123-4216-b7ef-940f8643e16b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:26.163687 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4cf11091-f123-4216-b7ef-940f8643e16b tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.206258 Apr 05 11:24:26.164270 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 628/1275] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:25 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:26.232300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4f2082b5-241d-4ac0-8bcb-4be89a651851 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:26.233303 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4f2082b5-241d-4ac0-8bcb-4be89a651851 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:26.239877 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f2082b5-241d-4ac0-8bcb-4be89a651851 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:26.240402 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f2082b5-241d-4ac0-8bcb-4be89a651851 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:26.241248 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f2082b5-241d-4ac0-8bcb-4be89a651851 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:26.241757 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f2082b5-241d-4ac0-8bcb-4be89a651851 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:26.296557 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2e6f6419-d763-45f9-af2d-c12416cc8876 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:26.297271 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2e6f6419-d763-45f9-af2d-c12416cc8876 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:26.303670 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2e6f6419-d763-45f9-af2d-c12416cc8876 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:26.304209 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2e6f6419-d763-45f9-af2d-c12416cc8876 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:26.305150 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2e6f6419-d763-45f9-af2d-c12416cc8876 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:26.305578 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2e6f6419-d763-45f9-af2d-c12416cc8876 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:26.404749 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4f2082b5-241d-4ac0-8bcb-4be89a651851 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:26.420610 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4f2082b5-241d-4ac0-8bcb-4be89a651851 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:26.426759 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4f2082b5-241d-4ac0-8bcb-4be89a651851 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:26.431849 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4f2082b5-241d-4ac0-8bcb-4be89a651851 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.203730 Apr 05 11:24:26.432622 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 648/1276] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:26 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:26.487250 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2e6f6419-d763-45f9-af2d-c12416cc8876 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:26.496791 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2e6f6419-d763-45f9-af2d-c12416cc8876 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.204387 Apr 05 11:24:26.497618 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 629/1277] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:26 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:27.070348 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-80f2c425-5ae1-45b6-83a9-50253b379475 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:27.071046 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-80f2c425-5ae1-45b6-83a9-50253b379475 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:27.080566 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80f2c425-5ae1-45b6-83a9-50253b379475 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:27.081052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80f2c425-5ae1-45b6-83a9-50253b379475 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:27.082450 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80f2c425-5ae1-45b6-83a9-50253b379475 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:27.082918 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80f2c425-5ae1-45b6-83a9-50253b379475 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:27.158824 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-80f2c425-5ae1-45b6-83a9-50253b379475 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:27.167559 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-80f2c425-5ae1-45b6-83a9-50253b379475 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.101608 Apr 05 11:24:27.168370 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 649/1278] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:27 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:27.182656 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-95fbcd95-0ae7-4498-9e05-f108fdf82b49 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:27.183275 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-95fbcd95-0ae7-4498-9e05-f108fdf82b49 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:27.190469 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-95fbcd95-0ae7-4498-9e05-f108fdf82b49 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:27.190946 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-95fbcd95-0ae7-4498-9e05-f108fdf82b49 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:27.191735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-95fbcd95-0ae7-4498-9e05-f108fdf82b49 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:27.192320 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-95fbcd95-0ae7-4498-9e05-f108fdf82b49 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:27.335867 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-95fbcd95-0ae7-4498-9e05-f108fdf82b49 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:27.343432 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-95fbcd95-0ae7-4498-9e05-f108fdf82b49 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.164756 Apr 05 11:24:27.344886 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 630/1279] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:27 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:27.450685 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0be65383-a45a-4d0c-a35b-90dcc973c5b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:27.451445 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0be65383-a45a-4d0c-a35b-90dcc973c5b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:27.457576 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0be65383-a45a-4d0c-a35b-90dcc973c5b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:27.458033 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0be65383-a45a-4d0c-a35b-90dcc973c5b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:27.459421 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0be65383-a45a-4d0c-a35b-90dcc973c5b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:27.459860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0be65383-a45a-4d0c-a35b-90dcc973c5b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:27.516551 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f4696a89-e954-456b-86d2-332992677f64 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:27.519971 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f4696a89-e954-456b-86d2-332992677f64 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:27.528127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4696a89-e954-456b-86d2-332992677f64 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:27.529278 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4696a89-e954-456b-86d2-332992677f64 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:27.530388 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4696a89-e954-456b-86d2-332992677f64 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:27.531095 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4696a89-e954-456b-86d2-332992677f64 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:27.671287 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0be65383-a45a-4d0c-a35b-90dcc973c5b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:27.678316 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0be65383-a45a-4d0c-a35b-90dcc973c5b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:27.679893 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0be65383-a45a-4d0c-a35b-90dcc973c5b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:27.681044 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0be65383-a45a-4d0c-a35b-90dcc973c5b1 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.234402 Apr 05 11:24:27.681614 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 650/1280] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:27 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:27.690395 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f4696a89-e954-456b-86d2-332992677f64 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:27.698383 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f4696a89-e954-456b-86d2-332992677f64 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.186960 Apr 05 11:24:27.698976 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 631/1281] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:27 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:28.184186 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-59b670f9-9b1f-4b2a-a76e-0a829b866ad4 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:28.185173 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-59b670f9-9b1f-4b2a-a76e-0a829b866ad4 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:28.191854 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59b670f9-9b1f-4b2a-a76e-0a829b866ad4 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:28.192296 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59b670f9-9b1f-4b2a-a76e-0a829b866ad4 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:28.193057 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59b670f9-9b1f-4b2a-a76e-0a829b866ad4 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:28.193731 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59b670f9-9b1f-4b2a-a76e-0a829b866ad4 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:28.271604 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-59b670f9-9b1f-4b2a-a76e-0a829b866ad4 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:28.285771 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-59b670f9-9b1f-4b2a-a76e-0a829b866ad4 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.105579 Apr 05 11:24:28.292313 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 651/1282] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:28 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:28.365554 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b72525f3-9fc8-4fbd-91b4-9e1074eea71f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:28.366264 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b72525f3-9fc8-4fbd-91b4-9e1074eea71f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:28.377205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b72525f3-9fc8-4fbd-91b4-9e1074eea71f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:28.377893 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b72525f3-9fc8-4fbd-91b4-9e1074eea71f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:28.379170 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b72525f3-9fc8-4fbd-91b4-9e1074eea71f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:28.379839 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b72525f3-9fc8-4fbd-91b4-9e1074eea71f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:28.771959 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ae5cb780-fc2c-4d4b-a2ea-66bf2222499d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:28.771959 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ae5cb780-fc2c-4d4b-a2ea-66bf2222499d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:28.771959 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ae5cb780-fc2c-4d4b-a2ea-66bf2222499d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:28.771959 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ae5cb780-fc2c-4d4b-a2ea-66bf2222499d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:28.772521 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ae5cb780-fc2c-4d4b-a2ea-66bf2222499d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:28.772521 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ae5cb780-fc2c-4d4b-a2ea-66bf2222499d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:28.918830 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b72525f3-9fc8-4fbd-91b4-9e1074eea71f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:28.928260 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b72525f3-9fc8-4fbd-91b4-9e1074eea71f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.569434 Apr 05 11:24:28.928846 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 632/1283] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:28 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:28.944051 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f2483dc7-f906-45d4-9572-a3e36ce0dc74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:28.945461 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f2483dc7-f906-45d4-9572-a3e36ce0dc74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:28.952325 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2483dc7-f906-45d4-9572-a3e36ce0dc74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:28.952773 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2483dc7-f906-45d4-9572-a3e36ce0dc74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:28.954351 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2483dc7-f906-45d4-9572-a3e36ce0dc74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:28.954885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2483dc7-f906-45d4-9572-a3e36ce0dc74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:28.963105 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ae5cb780-fc2c-4d4b-a2ea-66bf2222499d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:28.972173 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ae5cb780-fc2c-4d4b-a2ea-66bf2222499d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:28.974128 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ae5cb780-fc2c-4d4b-a2ea-66bf2222499d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:28.975878 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ae5cb780-fc2c-4d4b-a2ea-66bf2222499d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.280134 Apr 05 11:24:28.976638 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 652/1284] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:28 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:24:29.107325 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f2483dc7-f906-45d4-9572-a3e36ce0dc74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:29.115270 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f2483dc7-f906-45d4-9572-a3e36ce0dc74 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.185237 Apr 05 11:24:29.118676 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 633/1285] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:28 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:29.311828 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e92f951f-e188-4b11-b6c6-f4d39af08743 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:29.312464 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e92f951f-e188-4b11-b6c6-f4d39af08743 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:29.324790 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e92f951f-e188-4b11-b6c6-f4d39af08743 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:29.325223 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e92f951f-e188-4b11-b6c6-f4d39af08743 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:29.326018 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e92f951f-e188-4b11-b6c6-f4d39af08743 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:29.326453 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e92f951f-e188-4b11-b6c6-f4d39af08743 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:29.406940 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e92f951f-e188-4b11-b6c6-f4d39af08743 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:29.415861 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e92f951f-e188-4b11-b6c6-f4d39af08743 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.108282 Apr 05 11:24:29.416557 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 653/1286] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:29 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:29.949255 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-90304090-20b6-4b5f-bedf-ffd1877b7c8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:29.950127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-90304090-20b6-4b5f-bedf-ffd1877b7c8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:29.957844 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90304090-20b6-4b5f-bedf-ffd1877b7c8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:29.959241 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90304090-20b6-4b5f-bedf-ffd1877b7c8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:29.960279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90304090-20b6-4b5f-bedf-ffd1877b7c8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:29.960705 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90304090-20b6-4b5f-bedf-ffd1877b7c8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:29.996946 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b4eb4e48-d927-4ad7-9b15-c65991177d2c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:29.997998 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b4eb4e48-d927-4ad7-9b15-c65991177d2c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:30.007236 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b4eb4e48-d927-4ad7-9b15-c65991177d2c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:30.008077 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b4eb4e48-d927-4ad7-9b15-c65991177d2c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:30.009589 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b4eb4e48-d927-4ad7-9b15-c65991177d2c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:30.011041 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b4eb4e48-d927-4ad7-9b15-c65991177d2c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:30.132545 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-90304090-20b6-4b5f-bedf-ffd1877b7c8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:30.140838 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-90304090-20b6-4b5f-bedf-ffd1877b7c8e tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.198012 Apr 05 11:24:30.142447 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 634/1287] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:29 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:30.152912 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b5ff8892-6e2b-4bcc-8ef7-254be95fa974 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:30.152912 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b5ff8892-6e2b-4bcc-8ef7-254be95fa974 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:30.155497 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5ff8892-6e2b-4bcc-8ef7-254be95fa974 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:30.155942 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5ff8892-6e2b-4bcc-8ef7-254be95fa974 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:30.156718 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5ff8892-6e2b-4bcc-8ef7-254be95fa974 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:30.157147 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5ff8892-6e2b-4bcc-8ef7-254be95fa974 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:30.208044 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b4eb4e48-d927-4ad7-9b15-c65991177d2c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:30.217699 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b4eb4e48-d927-4ad7-9b15-c65991177d2c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:30.221640 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b4eb4e48-d927-4ad7-9b15-c65991177d2c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:30.223028 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b4eb4e48-d927-4ad7-9b15-c65991177d2c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.231062 Apr 05 11:24:30.224670 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 654/1288] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:29 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:30.345420 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b5ff8892-6e2b-4bcc-8ef7-254be95fa974 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:30.354704 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b5ff8892-6e2b-4bcc-8ef7-254be95fa974 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.210285 Apr 05 11:24:30.355486 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 635/1289] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:30 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:30.432267 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b9ddcaa7-e29b-4c9c-832f-300b6c48c390 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:30.433360 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b9ddcaa7-e29b-4c9c-832f-300b6c48c390 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:30.441449 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b9ddcaa7-e29b-4c9c-832f-300b6c48c390 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:30.442283 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b9ddcaa7-e29b-4c9c-832f-300b6c48c390 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:30.443439 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b9ddcaa7-e29b-4c9c-832f-300b6c48c390 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:30.444207 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b9ddcaa7-e29b-4c9c-832f-300b6c48c390 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:30.511671 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b9ddcaa7-e29b-4c9c-832f-300b6c48c390 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:30.524441 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b9ddcaa7-e29b-4c9c-832f-300b6c48c390 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.095990 Apr 05 11:24:30.525208 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 655/1290] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:30 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:31.161552 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eb59faff-4547-4a41-9b25-64a23c72afaa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:31.162825 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eb59faff-4547-4a41-9b25-64a23c72afaa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:31.173096 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb59faff-4547-4a41-9b25-64a23c72afaa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:31.174151 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb59faff-4547-4a41-9b25-64a23c72afaa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:31.175227 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb59faff-4547-4a41-9b25-64a23c72afaa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:31.175858 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb59faff-4547-4a41-9b25-64a23c72afaa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:31.243245 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-59d3928c-ea39-48d4-9f4e-06b5441bc369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:31.243860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-59d3928c-ea39-48d4-9f4e-06b5441bc369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:31.253815 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59d3928c-ea39-48d4-9f4e-06b5441bc369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:31.254410 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59d3928c-ea39-48d4-9f4e-06b5441bc369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:31.256137 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59d3928c-ea39-48d4-9f4e-06b5441bc369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:31.256921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59d3928c-ea39-48d4-9f4e-06b5441bc369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:31.355573 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eb59faff-4547-4a41-9b25-64a23c72afaa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:31.364061 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eb59faff-4547-4a41-9b25-64a23c72afaa tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.208706 Apr 05 11:24:31.365258 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 636/1291] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:31 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:31.379020 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a917dee6-17e2-4815-93e5-122d007a9551 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:31.379603 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a917dee6-17e2-4815-93e5-122d007a9551 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:31.385681 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a917dee6-17e2-4815-93e5-122d007a9551 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:31.386548 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a917dee6-17e2-4815-93e5-122d007a9551 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:31.387410 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a917dee6-17e2-4815-93e5-122d007a9551 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:31.387850 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a917dee6-17e2-4815-93e5-122d007a9551 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:31.467850 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-59d3928c-ea39-48d4-9f4e-06b5441bc369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:31.477297 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-59d3928c-ea39-48d4-9f4e-06b5441bc369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:31.478831 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-59d3928c-ea39-48d4-9f4e-06b5441bc369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:31.480091 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-59d3928c-ea39-48d4-9f4e-06b5441bc369 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.241577 Apr 05 11:24:31.480681 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 656/1292] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:31 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:24:31.548150 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d31c85ba-cc64-4657-bc01-11f43d1d4e09 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:31.551044 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d31c85ba-cc64-4657-bc01-11f43d1d4e09 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:31.563518 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d31c85ba-cc64-4657-bc01-11f43d1d4e09 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:31.564616 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d31c85ba-cc64-4657-bc01-11f43d1d4e09 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:31.566132 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d31c85ba-cc64-4657-bc01-11f43d1d4e09 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:31.567093 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d31c85ba-cc64-4657-bc01-11f43d1d4e09 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:31.689753 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d31c85ba-cc64-4657-bc01-11f43d1d4e09 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:31.698176 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d31c85ba-cc64-4657-bc01-11f43d1d4e09 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.158952 Apr 05 11:24:31.710776 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 657/1293] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:31 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:31.755964 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a917dee6-17e2-4815-93e5-122d007a9551 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:31.777654 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a917dee6-17e2-4815-93e5-122d007a9551 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.402928 Apr 05 11:24:31.778247 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 637/1294] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:31 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:32.384154 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-93329255-bc86-4aa2-bd4c-cab995f2b368 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:32.385367 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-93329255-bc86-4aa2-bd4c-cab995f2b368 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:32.394361 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93329255-bc86-4aa2-bd4c-cab995f2b368 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:32.395415 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93329255-bc86-4aa2-bd4c-cab995f2b368 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:32.401282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93329255-bc86-4aa2-bd4c-cab995f2b368 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:32.401282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93329255-bc86-4aa2-bd4c-cab995f2b368 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:32.499968 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7b419776-2565-44c7-8abd-cb11d7e877d4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:32.501234 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7b419776-2565-44c7-8abd-cb11d7e877d4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:32.513592 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b419776-2565-44c7-8abd-cb11d7e877d4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:32.514295 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b419776-2565-44c7-8abd-cb11d7e877d4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:32.515293 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b419776-2565-44c7-8abd-cb11d7e877d4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:32.515910 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b419776-2565-44c7-8abd-cb11d7e877d4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:32.599547 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-93329255-bc86-4aa2-bd4c-cab995f2b368 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:32.612079 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-93329255-bc86-4aa2-bd4c-cab995f2b368 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.233673 Apr 05 11:24:32.613184 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 658/1295] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:32 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:32.718581 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-13b55e44-c2c1-4166-b984-dc6b2a3909a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:32.719308 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-13b55e44-c2c1-4166-b984-dc6b2a3909a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:32.725526 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13b55e44-c2c1-4166-b984-dc6b2a3909a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:32.726029 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13b55e44-c2c1-4166-b984-dc6b2a3909a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:32.726850 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13b55e44-c2c1-4166-b984-dc6b2a3909a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:32.727305 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13b55e44-c2c1-4166-b984-dc6b2a3909a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:32.770511 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7b419776-2565-44c7-8abd-cb11d7e877d4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:32.781608 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7b419776-2565-44c7-8abd-cb11d7e877d4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:32.783805 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7b419776-2565-44c7-8abd-cb11d7e877d4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:32.785226 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7b419776-2565-44c7-8abd-cb11d7e877d4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.289582 Apr 05 11:24:32.785917 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 638/1296] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:32 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:24:32.796352 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4058cf7d-78f7-4289-8d75-f78dd0556494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:32.799587 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4058cf7d-78f7-4289-8d75-f78dd0556494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:32.806125 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4058cf7d-78f7-4289-8d75-f78dd0556494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:32.806585 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4058cf7d-78f7-4289-8d75-f78dd0556494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:32.807663 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4058cf7d-78f7-4289-8d75-f78dd0556494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:32.808116 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4058cf7d-78f7-4289-8d75-f78dd0556494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:32.835673 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-13b55e44-c2c1-4166-b984-dc6b2a3909a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:32.841948 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-13b55e44-c2c1-4166-b984-dc6b2a3909a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.127143 Apr 05 11:24:32.842547 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 659/1297] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:32 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:32.998127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4058cf7d-78f7-4289-8d75-f78dd0556494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:33.006458 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4058cf7d-78f7-4289-8d75-f78dd0556494 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.214182 Apr 05 11:24:33.008801 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 639/1298] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:32 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:33.631556 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-84787b36-591b-4eeb-8c5f-e69c2deee15c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:33.632408 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-84787b36-591b-4eeb-8c5f-e69c2deee15c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:33.640874 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84787b36-591b-4eeb-8c5f-e69c2deee15c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:33.641464 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84787b36-591b-4eeb-8c5f-e69c2deee15c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:33.642359 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84787b36-591b-4eeb-8c5f-e69c2deee15c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:33.642835 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84787b36-591b-4eeb-8c5f-e69c2deee15c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:33.783135 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-84787b36-591b-4eeb-8c5f-e69c2deee15c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:33.790778 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-84787b36-591b-4eeb-8c5f-e69c2deee15c tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.163384 Apr 05 11:24:33.791367 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 660/1299] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:33 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:33.806451 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-77d0b779-cfdc-40c2-8102-b142ede98079 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:33.806451 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-77d0b779-cfdc-40c2-8102-b142ede98079 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:33.813310 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-77d0b779-cfdc-40c2-8102-b142ede98079 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:33.813765 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-77d0b779-cfdc-40c2-8102-b142ede98079 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:33.814541 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-77d0b779-cfdc-40c2-8102-b142ede98079 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:33.815037 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-77d0b779-cfdc-40c2-8102-b142ede98079 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:33.864435 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4c401445-f5f2-4c4f-8a80-700156941fae tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:33.865061 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4c401445-f5f2-4c4f-8a80-700156941fae tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:33.871123 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c401445-f5f2-4c4f-8a80-700156941fae tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:33.871581 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c401445-f5f2-4c4f-8a80-700156941fae tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:33.872367 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c401445-f5f2-4c4f-8a80-700156941fae tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:33.872812 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c401445-f5f2-4c4f-8a80-700156941fae tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:33.938118 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4c401445-f5f2-4c4f-8a80-700156941fae tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:33.946167 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4c401445-f5f2-4c4f-8a80-700156941fae tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.085542 Apr 05 11:24:33.946823 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 661/1300] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:33 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:33.960241 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-77d0b779-cfdc-40c2-8102-b142ede98079 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:33.968146 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-77d0b779-cfdc-40c2-8102-b142ede98079 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:33.969630 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-77d0b779-cfdc-40c2-8102-b142ede98079 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:33.970835 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-77d0b779-cfdc-40c2-8102-b142ede98079 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.168957 Apr 05 11:24:33.971402 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 640/1301] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:33 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:34.024460 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bf0cf3dc-f8c3-44ba-8272-99550ef09a1f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:34.025132 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bf0cf3dc-f8c3-44ba-8272-99550ef09a1f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:34.031529 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bf0cf3dc-f8c3-44ba-8272-99550ef09a1f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:34.034222 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bf0cf3dc-f8c3-44ba-8272-99550ef09a1f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:34.034222 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bf0cf3dc-f8c3-44ba-8272-99550ef09a1f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:34.034222 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bf0cf3dc-f8c3-44ba-8272-99550ef09a1f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:34.187385 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bf0cf3dc-f8c3-44ba-8272-99550ef09a1f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:34.195798 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bf0cf3dc-f8c3-44ba-8272-99550ef09a1f tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.175361 Apr 05 11:24:34.196374 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 662/1302] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:34 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:34.809035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-96f93f58-8c5b-409e-a3f7-97ebf2a2d70f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:34.809644 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-96f93f58-8c5b-409e-a3f7-97ebf2a2d70f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:34.816118 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-96f93f58-8c5b-409e-a3f7-97ebf2a2d70f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:34.816576 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-96f93f58-8c5b-409e-a3f7-97ebf2a2d70f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:34.817368 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-96f93f58-8c5b-409e-a3f7-97ebf2a2d70f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:34.818454 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-96f93f58-8c5b-409e-a3f7-97ebf2a2d70f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:34.962138 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-96f93f58-8c5b-409e-a3f7-97ebf2a2d70f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:34.963013 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0aa7b051-5931-4328-9206-b7de17506867 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:34.963641 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0aa7b051-5931-4328-9206-b7de17506867 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:34.970224 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0aa7b051-5931-4328-9206-b7de17506867 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:34.970713 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0aa7b051-5931-4328-9206-b7de17506867 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:34.971531 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0aa7b051-5931-4328-9206-b7de17506867 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:34.971973 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0aa7b051-5931-4328-9206-b7de17506867 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:34.972425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-96f93f58-8c5b-409e-a3f7-97ebf2a2d70f tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.167320 Apr 05 11:24:34.973017 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 641/1303] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:34 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:34.992661 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d588aaa2-59c9-4663-ae0a-0bacca991a9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:34.993280 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d588aaa2-59c9-4663-ae0a-0bacca991a9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:34.999351 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d588aaa2-59c9-4663-ae0a-0bacca991a9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:34.999800 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d588aaa2-59c9-4663-ae0a-0bacca991a9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:35.000602 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d588aaa2-59c9-4663-ae0a-0bacca991a9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:35.001224 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d588aaa2-59c9-4663-ae0a-0bacca991a9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:35.037855 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0aa7b051-5931-4328-9206-b7de17506867 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:35.045997 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0aa7b051-5931-4328-9206-b7de17506867 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1224 microversion: 2.1 time: 0.086727 Apr 05 11:24:35.046595 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 663/1304] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:34 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:35.152892 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d588aaa2-59c9-4663-ae0a-0bacca991a9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:35.161093 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d588aaa2-59c9-4663-ae0a-0bacca991a9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:35.163150 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d588aaa2-59c9-4663-ae0a-0bacca991a9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:35.164332 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d588aaa2-59c9-4663-ae0a-0bacca991a9f tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.176305 Apr 05 11:24:35.164899 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 642/1305] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:34 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:24:35.213461 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1949f54d-a20c-4f17-bee1-5593d63c7437 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:35.213928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1949f54d-a20c-4f17-bee1-5593d63c7437 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:35.220746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1949f54d-a20c-4f17-bee1-5593d63c7437 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:35.221410 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1949f54d-a20c-4f17-bee1-5593d63c7437 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:35.222391 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1949f54d-a20c-4f17-bee1-5593d63c7437 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:35.222974 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1949f54d-a20c-4f17-bee1-5593d63c7437 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:35.390814 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1949f54d-a20c-4f17-bee1-5593d63c7437 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:35.398214 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1949f54d-a20c-4f17-bee1-5593d63c7437 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.188989 Apr 05 11:24:35.403943 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 664/1306] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:35 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:35.989445 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-86f45219-e6de-47c1-a7d1-7a6e295147a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:35.990044 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-86f45219-e6de-47c1-a7d1-7a6e295147a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:35.996489 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86f45219-e6de-47c1-a7d1-7a6e295147a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:35.996945 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86f45219-e6de-47c1-a7d1-7a6e295147a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:35.997708 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86f45219-e6de-47c1-a7d1-7a6e295147a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:35.998144 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86f45219-e6de-47c1-a7d1-7a6e295147a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:36.063318 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f0289fd5-fe61-4ae9-b2cd-2bb4d9ba922d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:36.064071 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f0289fd5-fe61-4ae9-b2cd-2bb4d9ba922d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:36.071527 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0289fd5-fe61-4ae9-b2cd-2bb4d9ba922d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:36.071980 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0289fd5-fe61-4ae9-b2cd-2bb4d9ba922d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:36.072889 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0289fd5-fe61-4ae9-b2cd-2bb4d9ba922d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:36.073345 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0289fd5-fe61-4ae9-b2cd-2bb4d9ba922d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:36.103917 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0289fd5-fe61-4ae9-b2cd-2bb4d9ba922d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:36.104378 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0289fd5-fe61-4ae9-b2cd-2bb4d9ba922d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:36.104828 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-f0289fd5-fe61-4ae9-b2cd-2bb4d9ba922d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lazy-loading 'fault' on Instance uuid 1af2a30d-f115-44a9-9a90-d1699560bd75 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:24:36.141233 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-86f45219-e6de-47c1-a7d1-7a6e295147a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:36.149188 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f0289fd5-fe61-4ae9-b2cd-2bb4d9ba922d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:36.149432 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-86f45219-e6de-47c1-a7d1-7a6e295147a6 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.163646 Apr 05 11:24:36.149873 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 643/1307] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:35 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:36.156869 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f0289fd5-fe61-4ae9-b2cd-2bb4d9ba922d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1229 microversion: 2.1 time: 0.098458 Apr 05 11:24:36.157468 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 665/1308] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:36 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:36.183181 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-75986f1c-f42c-4e99-a0f3-64c6563300dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:36.183948 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-75986f1c-f42c-4e99-a0f3-64c6563300dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:36.190260 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75986f1c-f42c-4e99-a0f3-64c6563300dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:36.190737 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75986f1c-f42c-4e99-a0f3-64c6563300dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:36.191517 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75986f1c-f42c-4e99-a0f3-64c6563300dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:36.191950 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75986f1c-f42c-4e99-a0f3-64c6563300dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:36.330954 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-75986f1c-f42c-4e99-a0f3-64c6563300dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:36.343314 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-75986f1c-f42c-4e99-a0f3-64c6563300dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:36.344819 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-75986f1c-f42c-4e99-a0f3-64c6563300dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:36.345970 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-75986f1c-f42c-4e99-a0f3-64c6563300dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.166879 Apr 05 11:24:36.346526 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 644/1309] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:36 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:36.419955 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-46ac0e60-d638-4d32-94eb-2b0dac758a15 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:36.420590 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-46ac0e60-d638-4d32-94eb-2b0dac758a15 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:36.426788 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-46ac0e60-d638-4d32-94eb-2b0dac758a15 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:36.427129 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-46ac0e60-d638-4d32-94eb-2b0dac758a15 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:36.427889 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-46ac0e60-d638-4d32-94eb-2b0dac758a15 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:36.428319 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-46ac0e60-d638-4d32-94eb-2b0dac758a15 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:36.568392 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-46ac0e60-d638-4d32-94eb-2b0dac758a15 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:36.576059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-46ac0e60-d638-4d32-94eb-2b0dac758a15 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.160197 Apr 05 11:24:36.576634 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 666/1310] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:36 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:37.171932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-90ff3f2f-2018-4b21-98af-85422f60beaf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:37.173189 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-90ff3f2f-2018-4b21-98af-85422f60beaf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:37.183606 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-920f6b5c-54e6-4c3e-9272-ab985a8676fd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:37.185576 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90ff3f2f-2018-4b21-98af-85422f60beaf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:37.186336 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90ff3f2f-2018-4b21-98af-85422f60beaf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:37.186856 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-920f6b5c-54e6-4c3e-9272-ab985a8676fd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:37.188004 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90ff3f2f-2018-4b21-98af-85422f60beaf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:37.188617 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-90ff3f2f-2018-4b21-98af-85422f60beaf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:37.203386 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-920f6b5c-54e6-4c3e-9272-ab985a8676fd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:37.205849 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-920f6b5c-54e6-4c3e-9272-ab985a8676fd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:37.207415 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-920f6b5c-54e6-4c3e-9272-ab985a8676fd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:37.210634 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-920f6b5c-54e6-4c3e-9272-ab985a8676fd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:37.245044 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-920f6b5c-54e6-4c3e-9272-ab985a8676fd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:37.245492 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-920f6b5c-54e6-4c3e-9272-ab985a8676fd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:37.245944 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-920f6b5c-54e6-4c3e-9272-ab985a8676fd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lazy-loading 'fault' on Instance uuid 1af2a30d-f115-44a9-9a90-d1699560bd75 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:24:37.290501 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-920f6b5c-54e6-4c3e-9272-ab985a8676fd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:37.298209 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-920f6b5c-54e6-4c3e-9272-ab985a8676fd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1229 microversion: 2.1 time: 0.128006 Apr 05 11:24:37.298830 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 667/1311] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:37 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1229 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:37.351434 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-90ff3f2f-2018-4b21-98af-85422f60beaf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:37.359099 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-90ff3f2f-2018-4b21-98af-85422f60beaf tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.190982 Apr 05 11:24:37.359673 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 645/1312] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:37 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:37.373206 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d2a9189d-de58-4b45-b721-26025fb3bd66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:37.373825 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d2a9189d-de58-4b45-b721-26025fb3bd66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:37.379917 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2a9189d-de58-4b45-b721-26025fb3bd66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:37.380361 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2a9189d-de58-4b45-b721-26025fb3bd66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:37.381133 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2a9189d-de58-4b45-b721-26025fb3bd66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:37.383276 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2a9189d-de58-4b45-b721-26025fb3bd66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:37.516861 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d2a9189d-de58-4b45-b721-26025fb3bd66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:37.524566 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d2a9189d-de58-4b45-b721-26025fb3bd66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:37.526063 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d2a9189d-de58-4b45-b721-26025fb3bd66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:37.527233 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d2a9189d-de58-4b45-b721-26025fb3bd66 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.157928 Apr 05 11:24:37.530308 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 668/1313] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:37 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:24:37.593338 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2cd19bde-7cee-428e-b571-e519889db7ab tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:37.593854 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2cd19bde-7cee-428e-b571-e519889db7ab tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:37.601371 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2cd19bde-7cee-428e-b571-e519889db7ab tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:37.601820 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2cd19bde-7cee-428e-b571-e519889db7ab tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:37.602588 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2cd19bde-7cee-428e-b571-e519889db7ab tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:37.603046 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2cd19bde-7cee-428e-b571-e519889db7ab tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:37.746875 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2cd19bde-7cee-428e-b571-e519889db7ab tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:37.754403 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2cd19bde-7cee-428e-b571-e519889db7ab tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.164948 Apr 05 11:24:37.755015 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 646/1314] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:37 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:38.314656 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ccda4644-15ae-4a1d-8177-e531bf325d0d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:38.315263 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ccda4644-15ae-4a1d-8177-e531bf325d0d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:38.321563 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ccda4644-15ae-4a1d-8177-e531bf325d0d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:38.322003 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ccda4644-15ae-4a1d-8177-e531bf325d0d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:38.322802 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ccda4644-15ae-4a1d-8177-e531bf325d0d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:38.323235 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ccda4644-15ae-4a1d-8177-e531bf325d0d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:38.352726 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ccda4644-15ae-4a1d-8177-e531bf325d0d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:38.353241 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ccda4644-15ae-4a1d-8177-e531bf325d0d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:38.353674 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-ccda4644-15ae-4a1d-8177-e531bf325d0d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lazy-loading 'fault' on Instance uuid 1af2a30d-f115-44a9-9a90-d1699560bd75 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:24:38.377025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-216ca65e-1bd5-43f9-9bf0-55f47bb82c94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:38.377638 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-216ca65e-1bd5-43f9-9bf0-55f47bb82c94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:38.386457 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-216ca65e-1bd5-43f9-9bf0-55f47bb82c94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:38.387199 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-216ca65e-1bd5-43f9-9bf0-55f47bb82c94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:38.388425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-216ca65e-1bd5-43f9-9bf0-55f47bb82c94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:38.389139 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-216ca65e-1bd5-43f9-9bf0-55f47bb82c94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:38.397267 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ccda4644-15ae-4a1d-8177-e531bf325d0d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:38.404573 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ccda4644-15ae-4a1d-8177-e531bf325d0d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1229 microversion: 2.1 time: 0.093828 Apr 05 11:24:38.405173 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 669/1315] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:38 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1229 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:38.522839 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-216ca65e-1bd5-43f9-9bf0-55f47bb82c94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:38.530526 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-216ca65e-1bd5-43f9-9bf0-55f47bb82c94 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.157427 Apr 05 11:24:38.531127 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 647/1316] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:38 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:38.546941 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c7309546-74b4-4cbe-9c3a-fff23f375c5d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:38.546941 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c7309546-74b4-4cbe-9c3a-fff23f375c5d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:38.551988 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c7309546-74b4-4cbe-9c3a-fff23f375c5d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:38.552462 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c7309546-74b4-4cbe-9c3a-fff23f375c5d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:38.553219 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c7309546-74b4-4cbe-9c3a-fff23f375c5d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:38.553654 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c7309546-74b4-4cbe-9c3a-fff23f375c5d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:38.685481 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c7309546-74b4-4cbe-9c3a-fff23f375c5d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:38.693555 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c7309546-74b4-4cbe-9c3a-fff23f375c5d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:38.695092 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c7309546-74b4-4cbe-9c3a-fff23f375c5d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:38.696244 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c7309546-74b4-4cbe-9c3a-fff23f375c5d tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.155039 Apr 05 11:24:38.696843 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 670/1317] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:38 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:38.771909 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-18326d5b-e81c-42ab-8d46-741b0f53d9b6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:38.772515 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-18326d5b-e81c-42ab-8d46-741b0f53d9b6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:38.778363 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-18326d5b-e81c-42ab-8d46-741b0f53d9b6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:38.778853 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-18326d5b-e81c-42ab-8d46-741b0f53d9b6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:38.779616 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-18326d5b-e81c-42ab-8d46-741b0f53d9b6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:38.780046 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-18326d5b-e81c-42ab-8d46-741b0f53d9b6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:38.913372 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-18326d5b-e81c-42ab-8d46-741b0f53d9b6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:38.920688 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-18326d5b-e81c-42ab-8d46-741b0f53d9b6 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.153082 Apr 05 11:24:38.921255 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 648/1318] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:38 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:39.422005 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8ba91de9-49f2-460f-9a27-546acee09465 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:39.423308 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8ba91de9-49f2-460f-9a27-546acee09465 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:39.431030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ba91de9-49f2-460f-9a27-546acee09465 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:39.431751 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ba91de9-49f2-460f-9a27-546acee09465 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:39.431907 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ba91de9-49f2-460f-9a27-546acee09465 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:39.432388 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ba91de9-49f2-460f-9a27-546acee09465 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:39.466315 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ba91de9-49f2-460f-9a27-546acee09465 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:39.466315 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ba91de9-49f2-460f-9a27-546acee09465 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:39.466508 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-8ba91de9-49f2-460f-9a27-546acee09465 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lazy-loading 'fault' on Instance uuid 1af2a30d-f115-44a9-9a90-d1699560bd75 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:24:39.509543 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8ba91de9-49f2-460f-9a27-546acee09465 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:39.517312 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8ba91de9-49f2-460f-9a27-546acee09465 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 200 len: 1229 microversion: 2.1 time: 0.099317 Apr 05 11:24:39.523915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 671/1319] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:39 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:39.548496 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a29e35f2-0dbe-4018-8a53-fc4669ebd4c0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:39.549551 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a29e35f2-0dbe-4018-8a53-fc4669ebd4c0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:39.557040 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a29e35f2-0dbe-4018-8a53-fc4669ebd4c0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:39.557489 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a29e35f2-0dbe-4018-8a53-fc4669ebd4c0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:39.558263 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a29e35f2-0dbe-4018-8a53-fc4669ebd4c0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:39.558738 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a29e35f2-0dbe-4018-8a53-fc4669ebd4c0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:39.714473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-51e1171a-b469-41a9-a177-15231be92ba7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:39.715143 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-51e1171a-b469-41a9-a177-15231be92ba7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:39.721261 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51e1171a-b469-41a9-a177-15231be92ba7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:39.721681 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51e1171a-b469-41a9-a177-15231be92ba7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:39.722460 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51e1171a-b469-41a9-a177-15231be92ba7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:39.722936 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51e1171a-b469-41a9-a177-15231be92ba7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:39.830821 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a29e35f2-0dbe-4018-8a53-fc4669ebd4c0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:39.847405 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a29e35f2-0dbe-4018-8a53-fc4669ebd4c0 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1673 microversion: 2.1 time: 0.302543 Apr 05 11:24:39.848416 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 649/1320] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:39 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1673 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:39.941040 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-51e1171a-b469-41a9-a177-15231be92ba7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:39.947231 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-799b2d89-e484-4de3-985f-5bbfb3bc658b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:39.948781 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-799b2d89-e484-4de3-985f-5bbfb3bc658b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:39.964791 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-799b2d89-e484-4de3-985f-5bbfb3bc658b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:39.965186 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-51e1171a-b469-41a9-a177-15231be92ba7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:39.969046 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-799b2d89-e484-4de3-985f-5bbfb3bc658b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:39.969046 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-799b2d89-e484-4de3-985f-5bbfb3bc658b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:39.969393 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-51e1171a-b469-41a9-a177-15231be92ba7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:39.969511 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-799b2d89-e484-4de3-985f-5bbfb3bc658b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:39.969651 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-51e1171a-b469-41a9-a177-15231be92ba7 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.257821 Apr 05 11:24:39.969651 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 672/1321] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:39 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:40.483292 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-799b2d89-e484-4de3-985f-5bbfb3bc658b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:40.494145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-799b2d89-e484-4de3-985f-5bbfb3bc658b tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1569 microversion: 2.1 time: 0.560556 Apr 05 11:24:40.495881 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 650/1322] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:39 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1569 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:40.538333 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-949709e2-c896-4647-aed6-13e841f75d56 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:40.539731 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-949709e2-c896-4647-aed6-13e841f75d56 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:40.553480 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-949709e2-c896-4647-aed6-13e841f75d56 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:40.554262 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-949709e2-c896-4647-aed6-13e841f75d56 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:40.556306 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-949709e2-c896-4647-aed6-13e841f75d56 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:40.557013 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-949709e2-c896-4647-aed6-13e841f75d56 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:40.579217 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-949709e2-c896-4647-aed6-13e841f75d56 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] HTTP exception thrown: Instance 1af2a30d-f115-44a9-9a90-d1699560bd75 could not be found. Apr 05 11:24:40.582757 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-949709e2-c896-4647-aed6-13e841f75d56 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Returning 404 to user: Instance 1af2a30d-f115-44a9-9a90-d1699560bd75 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:24:40.588096 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-949709e2-c896-4647-aed6-13e841f75d56 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 404 len: 111 microversion: 2.1 time: 0.056103 Apr 05 11:24:40.597194 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 673/1323] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:40 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:24:40.717226 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-798713015", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-72033448", "security_groups": [{"name": "tempest-secgroup-smoke-300189603"}], "block_device_mapping_v2": [{"uuid": "20082c8b-08e7-41f6-8081-03a9831f1d3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "15ec88ec-a078-4d94-a658-456bc06f4f38"}]}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:24:40.866387 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-68241b43-22d3-45bd-a199-cac5bf154704 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:40.867309 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-68241b43-22d3-45bd-a199-cac5bf154704 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:40.873961 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68241b43-22d3-45bd-a199-cac5bf154704 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:40.874474 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68241b43-22d3-45bd-a199-cac5bf154704 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:40.875258 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68241b43-22d3-45bd-a199-cac5bf154704 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:40.875902 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68241b43-22d3-45bd-a199-cac5bf154704 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:40.944208 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-68241b43-22d3-45bd-a199-cac5bf154704 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:40.945027 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] validate_networks() for [('15ec88ec-a078-4d94-a658-456bc06f4f38', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:24:40.950423 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-68241b43-22d3-45bd-a199-cac5bf154704 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1605 microversion: 2.1 time: 0.088313 Apr 05 11:24:40.951590 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 674/1324] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:40 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1605 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:40.988740 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-54dea5f4-f106-4a47-94c8-6fe643ff31dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:40.990259 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-54dea5f4-f106-4a47-94c8-6fe643ff31dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:40.996769 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-54dea5f4-f106-4a47-94c8-6fe643ff31dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:40.997216 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-54dea5f4-f106-4a47-94c8-6fe643ff31dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:40.997998 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-54dea5f4-f106-4a47-94c8-6fe643ff31dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:40.998428 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-54dea5f4-f106-4a47-94c8-6fe643ff31dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:41.255819 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-54dea5f4-f106-4a47-94c8-6fe643ff31dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:41.267230 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-54dea5f4-f106-4a47-94c8-6fe643ff31dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:41.272500 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-54dea5f4-f106-4a47-94c8-6fe643ff31dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:41.273972 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-54dea5f4-f106-4a47-94c8-6fe643ff31dd tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.290820 Apr 05 11:24:41.275264 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 675/1325] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:40 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:24:41.335552 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-083909be-84f7-445f-92d7-e62af7ba05d6 req-398f5f9b-8e77-4193-906f-5ef5e1f06424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ad1a46-8a77-4def-b880-e32ca5f36db1", "name": "network-vif-deleted", "tag": "8634b263-44cb-4aa1-94a2-580363a6f345"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:24:41.344650 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-083909be-84f7-445f-92d7-e62af7ba05d6 req-398f5f9b-8e77-4193-906f-5ef5e1f06424 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:41.345294 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-083909be-84f7-445f-92d7-e62af7ba05d6 req-398f5f9b-8e77-4193-906f-5ef5e1f06424 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:41.368938 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-083909be-84f7-445f-92d7-e62af7ba05d6 req-398f5f9b-8e77-4193-906f-5ef5e1f06424 service nova] Creating event network-vif-deleted:8634b263-44cb-4aa1-94a2-580363a6f345 for instance f5ad1a46-8a77-4def-b880-e32ca5f36db1 on hv-cinder-81899 Apr 05 11:24:41.374348 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-083909be-84f7-445f-92d7-e62af7ba05d6 req-398f5f9b-8e77-4193-906f-5ef5e1f06424 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044462 Apr 05 11:24:41.375129 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 676/1326] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:24:41.513921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b001f93d-f36a-49c4-8094-70a67d9db51d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:41.514764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b001f93d-f36a-49c4-8094-70a67d9db51d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:41.524368 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b001f93d-f36a-49c4-8094-70a67d9db51d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:41.524999 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b001f93d-f36a-49c4-8094-70a67d9db51d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:41.525873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b001f93d-f36a-49c4-8094-70a67d9db51d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:41.526427 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b001f93d-f36a-49c4-8094-70a67d9db51d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:41.595842 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b001f93d-f36a-49c4-8094-70a67d9db51d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:41.603693 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b001f93d-f36a-49c4-8094-70a67d9db51d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1382 microversion: 2.1 time: 0.094294 Apr 05 11:24:41.604271 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 677/1327] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:41 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1382 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:41.670790 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:24:41.671450 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:24:41.672211 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:24:41.681504 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:24:41.681504 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:24:41.694715 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:41.697225 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:41.698373 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:41.698934 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:41.718070 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Getting quotas for project 0c1827315aac4bfdacff856a13f90eb5. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:24:41.724659 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Getting quotas for user 068fa3223349449db508a275fa38ffdb and project 0c1827315aac4bfdacff856a13f90eb5. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:24:41.809088 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:24:41.811598 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20082c8b-08e7-41f6-8081-03a9831f1d3d',volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:24:41.968463 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-32fabf0f-f29c-4c88-afe1-e890d3926889 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:41.969361 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-32fabf0f-f29c-4c88-afe1-e890d3926889 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:41.975814 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32fabf0f-f29c-4c88-afe1-e890d3926889 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:41.979882 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32fabf0f-f29c-4c88-afe1-e890d3926889 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:41.979882 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32fabf0f-f29c-4c88-afe1-e890d3926889 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:41.979882 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32fabf0f-f29c-4c88-afe1-e890d3926889 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:42.010507 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32fabf0f-f29c-4c88-afe1-e890d3926889 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:42.011013 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32fabf0f-f29c-4c88-afe1-e890d3926889 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:42.011453 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-32fabf0f-f29c-4c88-afe1-e890d3926889 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lazy-loading 'fault' on Instance uuid f5ad1a46-8a77-4def-b880-e32ca5f36db1 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:24:42.071038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-32fabf0f-f29c-4c88-afe1-e890d3926889 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5466bcb6971420bb3a765a38bb008a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6061eea75194ee5b5efeed2e6073d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:42.093347 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-32fabf0f-f29c-4c88-afe1-e890d3926889 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 200 len: 1326 microversion: 2.1 time: 0.128580 Apr 05 11:24:42.094059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 678/1328] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:41 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 1326 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:42.293666 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b5ebd387-1788-46c3-af2a-24e01bec459c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:42.294286 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b5ebd387-1788-46c3-af2a-24e01bec459c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:42.311915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5ebd387-1788-46c3-af2a-24e01bec459c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:42.312275 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5ebd387-1788-46c3-af2a-24e01bec459c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:42.313317 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5ebd387-1788-46c3-af2a-24e01bec459c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:42.313808 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5ebd387-1788-46c3-af2a-24e01bec459c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:42.364031 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e978248f-0e90-4490-a78d-eb467a6a9636 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.650913 Apr 05 11:24:42.365511 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 651/1329] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:24:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 11:24:42.378514 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9a54447a-8de9-4696-baee-14b227edbe34 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:42.378514 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9a54447a-8de9-4696-baee-14b227edbe34 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:42.501146 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9a54447a-8de9-4696-baee-14b227edbe34 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:42.517921 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9a54447a-8de9-4696-baee-14b227edbe34 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1092 microversion: 2.1 time: 0.145852 Apr 05 11:24:42.519198 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 652/1330] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:42 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1092 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:42.577837 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b5ebd387-1788-46c3-af2a-24e01bec459c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:42.588911 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b5ebd387-1788-46c3-af2a-24e01bec459c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:42.591287 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b5ebd387-1788-46c3-af2a-24e01bec459c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:42.593082 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b5ebd387-1788-46c3-af2a-24e01bec459c tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.303391 Apr 05 11:24:42.598826 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 679/1331] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:42 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:24:42.621008 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5f4f6209-d8b6-4b30-ae34-b74a4aabcd0d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:42.631571 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5f4f6209-d8b6-4b30-ae34-b74a4aabcd0d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:42.631571 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f4f6209-d8b6-4b30-ae34-b74a4aabcd0d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:42.631571 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f4f6209-d8b6-4b30-ae34-b74a4aabcd0d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:42.632680 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f4f6209-d8b6-4b30-ae34-b74a4aabcd0d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:42.633276 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f4f6209-d8b6-4b30-ae34-b74a4aabcd0d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:42.676187 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f4f6209-d8b6-4b30-ae34-b74a4aabcd0d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:42.677016 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f4f6209-d8b6-4b30-ae34-b74a4aabcd0d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:42.677755 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-5f4f6209-d8b6-4b30-ae34-b74a4aabcd0d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lazy-loading 'fault' on Instance uuid e4e16432-3df3-4325-b757-906fbbeca604 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:24:42.731922 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5f4f6209-d8b6-4b30-ae34-b74a4aabcd0d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33726523008433e826ed90d0ae5e81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e907fc457e4c4396437b93bfa31859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:42.746849 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5f4f6209-d8b6-4b30-ae34-b74a4aabcd0d tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 200 len: 1224 microversion: 2.1 time: 0.129315 Apr 05 11:24:42.748355 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 653/1332] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:42 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 1224 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:43.018180 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-1ef17933-80da-4fea-9906-a3aead0280ab req-02bfc8a6-e5b9-4419-9bbf-0cd2eb938b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "078668ec-0695-4717-bef7-1153cdc2dd14", "name": "network-vif-plugged", "status": "completed", "tag": "f631937a-090e-4c88-959c-bbf9308dfac9"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:24:43.029029 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-1ef17933-80da-4fea-9906-a3aead0280ab req-02bfc8a6-e5b9-4419-9bbf-0cd2eb938b86 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:43.029488 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-1ef17933-80da-4fea-9906-a3aead0280ab req-02bfc8a6-e5b9-4419-9bbf-0cd2eb938b86 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:43.042550 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-1ef17933-80da-4fea-9906-a3aead0280ab req-02bfc8a6-e5b9-4419-9bbf-0cd2eb938b86 service nova] Creating event network-vif-plugged:f631937a-090e-4c88-959c-bbf9308dfac9 for instance 078668ec-0695-4717-bef7-1153cdc2dd14 on hv-cinder-81899 Apr 05 11:24:43.048300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-1ef17933-80da-4fea-9906-a3aead0280ab req-02bfc8a6-e5b9-4419-9bbf-0cd2eb938b86 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.345033 Apr 05 11:24:43.049159 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 680/1333] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:24:43.111552 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-216290f7-95f8-4f15-bc57-e0af82e1fcbd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:43.112167 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-216290f7-95f8-4f15-bc57-e0af82e1fcbd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:43.119765 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-216290f7-95f8-4f15-bc57-e0af82e1fcbd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:43.120218 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-216290f7-95f8-4f15-bc57-e0af82e1fcbd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:43.123252 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-216290f7-95f8-4f15-bc57-e0af82e1fcbd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:43.123252 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-216290f7-95f8-4f15-bc57-e0af82e1fcbd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:43.138944 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-216290f7-95f8-4f15-bc57-e0af82e1fcbd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] HTTP exception thrown: Instance f5ad1a46-8a77-4def-b880-e32ca5f36db1 could not be found. Apr 05 11:24:43.139552 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-216290f7-95f8-4f15-bc57-e0af82e1fcbd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Returning 404 to user: Instance f5ad1a46-8a77-4def-b880-e32ca5f36db1 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:24:43.140395 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-216290f7-95f8-4f15-bc57-e0af82e1fcbd tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 404 len: 111 microversion: 2.1 time: 0.033022 Apr 05 11:24:43.140967 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 654/1334] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:43 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:24:43.150371 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0cf34c66-a96e-45df-8d89-0f9fa9124777 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '.version_select at 0x7fec108ad700>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:43.272351 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0cf34c66-a96e-45df-8d89-0f9fa9124777 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653272782" status: 202 len: 0 microversion: 2.1 time: 0.126082 Apr 05 11:24:43.276671 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 681/1335] 10.222.0.39 () {58 vars in 1217 bytes} [Tue Apr 5 11:24:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653272782 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:24:43.396204 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-501f5686-9d98-43b3-a70e-2e3e2b03c4a4 req-6a96dd2b-c933-42b2-bece-f0b9dc052d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4e16432-3df3-4325-b757-906fbbeca604", "name": "network-vif-deleted", "tag": "dc377578-0184-4a80-88e0-2385eab5c0c4"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:24:43.404771 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-501f5686-9d98-43b3-a70e-2e3e2b03c4a4 req-6a96dd2b-c933-42b2-bece-f0b9dc052d70 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:43.405546 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-501f5686-9d98-43b3-a70e-2e3e2b03c4a4 req-6a96dd2b-c933-42b2-bece-f0b9dc052d70 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:43.417877 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-501f5686-9d98-43b3-a70e-2e3e2b03c4a4 req-6a96dd2b-c933-42b2-bece-f0b9dc052d70 service nova] Creating event network-vif-deleted:dc377578-0184-4a80-88e0-2385eab5c0c4 for instance e4e16432-3df3-4325-b757-906fbbeca604 on hv-cinder-81899 Apr 05 11:24:43.423599 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-501f5686-9d98-43b3-a70e-2e3e2b03c4a4 req-6a96dd2b-c933-42b2-bece-f0b9dc052d70 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031299 Apr 05 11:24:43.424791 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 655/1336] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:24:43.538024 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-270421c0-c22d-4cb0-9108-1995033c29a1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:43.538830 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-270421c0-c22d-4cb0-9108-1995033c29a1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:43.545405 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-270421c0-c22d-4cb0-9108-1995033c29a1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:43.545861 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-270421c0-c22d-4cb0-9108-1995033c29a1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:43.546955 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-270421c0-c22d-4cb0-9108-1995033c29a1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:43.547165 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-270421c0-c22d-4cb0-9108-1995033c29a1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:43.617168 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e418b142-98c2-47ea-9d52-bc078be7a3a3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:43.618173 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e418b142-98c2-47ea-9d52-bc078be7a3a3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:43.624270 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-270421c0-c22d-4cb0-9108-1995033c29a1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:43.625415 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e418b142-98c2-47ea-9d52-bc078be7a3a3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:43.626253 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e418b142-98c2-47ea-9d52-bc078be7a3a3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:43.627413 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e418b142-98c2-47ea-9d52-bc078be7a3a3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:43.628257 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e418b142-98c2-47ea-9d52-bc078be7a3a3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:43.637553 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-270421c0-c22d-4cb0-9108-1995033c29a1 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1142 microversion: 2.1 time: 0.103740 Apr 05 11:24:43.638158 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 682/1337] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:43 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1142 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:43.765482 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bf9d0239-ad02-4d84-9b85-92f104be02d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:43.766103 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bf9d0239-ad02-4d84-9b85-92f104be02d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] [instance: e4e16432-3df3-4325-b757-906fbbeca604] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:43.773183 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bf9d0239-ad02-4d84-9b85-92f104be02d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:43.773886 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bf9d0239-ad02-4d84-9b85-92f104be02d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:43.774908 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bf9d0239-ad02-4d84-9b85-92f104be02d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:43.775564 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bf9d0239-ad02-4d84-9b85-92f104be02d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:43.803183 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-bf9d0239-ad02-4d84-9b85-92f104be02d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] HTTP exception thrown: Instance e4e16432-3df3-4325-b757-906fbbeca604 could not be found. Apr 05 11:24:43.803781 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bf9d0239-ad02-4d84-9b85-92f104be02d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Returning 404 to user: Instance e4e16432-3df3-4325-b757-906fbbeca604 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:24:43.804874 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bf9d0239-ad02-4d84-9b85-92f104be02d0 tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604" status: 404 len: 111 microversion: 2.1 time: 0.043436 Apr 05 11:24:43.805516 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 683/1338] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:43 2022] GET /compute/v2.1/servers/e4e16432-3df3-4325-b757-906fbbeca604 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:24:43.948159 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e418b142-98c2-47ea-9d52-bc078be7a3a3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:43.956376 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e418b142-98c2-47ea-9d52-bc078be7a3a3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:43.958803 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e418b142-98c2-47ea-9d52-bc078be7a3a3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:43.960268 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e418b142-98c2-47ea-9d52-bc078be7a3a3 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.349700 Apr 05 11:24:43.970957 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 656/1339] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:43 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:44.139404 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0359e6b2-fce6-446e-b7b5-f2103c24577a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] Calling method '.version_select at 0x7fec0c0fa1f0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:44.322202 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0359e6b2-fce6-446e-b7b5-f2103c24577a tempest-TestShelveInstance-1965282527 tempest-TestShelveInstance-1965282527-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2074523442" status: 202 len: 0 microversion: 2.1 time: 0.187015 Apr 05 11:24:44.326269 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 684/1340] 10.222.0.39 () {58 vars in 1253 bytes} [Tue Apr 5 11:24:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2074523442 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:24:44.664564 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e9898a0c-66ba-4922-b4e5-997595a8ea76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:44.665730 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e9898a0c-66ba-4922-b4e5-997595a8ea76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:44.686842 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e9898a0c-66ba-4922-b4e5-997595a8ea76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:44.687712 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e9898a0c-66ba-4922-b4e5-997595a8ea76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:44.689203 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e9898a0c-66ba-4922-b4e5-997595a8ea76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:44.689971 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e9898a0c-66ba-4922-b4e5-997595a8ea76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:44.778374 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e9898a0c-66ba-4922-b4e5-997595a8ea76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:44.787501 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e9898a0c-66ba-4922-b4e5-997595a8ea76 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1190 microversion: 2.1 time: 0.126573 Apr 05 11:24:44.788292 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 657/1341] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:44 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1190 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:44.990872 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a9dd763e-663a-4cc7-99e4-8c20360e4e9e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:44.991498 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a9dd763e-663a-4cc7-99e4-8c20360e4e9e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:44.999267 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a9dd763e-663a-4cc7-99e4-8c20360e4e9e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:44.999850 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a9dd763e-663a-4cc7-99e4-8c20360e4e9e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:45.000901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a9dd763e-663a-4cc7-99e4-8c20360e4e9e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:45.001680 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a9dd763e-663a-4cc7-99e4-8c20360e4e9e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:45.617234 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a9dd763e-663a-4cc7-99e4-8c20360e4e9e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:45.626147 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a9dd763e-663a-4cc7-99e4-8c20360e4e9e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:45.628540 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a9dd763e-663a-4cc7-99e4-8c20360e4e9e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:45.631393 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a9dd763e-663a-4cc7-99e4-8c20360e4e9e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.655506 Apr 05 11:24:45.632959 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 685/1342] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:44 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:45.805564 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-33e235b5-26d6-4eb2-bef3-cc84389d1ea3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:45.807555 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-33e235b5-26d6-4eb2-bef3-cc84389d1ea3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:45.818169 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-33e235b5-26d6-4eb2-bef3-cc84389d1ea3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:45.823496 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-33e235b5-26d6-4eb2-bef3-cc84389d1ea3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:45.824654 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-33e235b5-26d6-4eb2-bef3-cc84389d1ea3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:45.826785 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-33e235b5-26d6-4eb2-bef3-cc84389d1ea3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:45.916833 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-33e235b5-26d6-4eb2-bef3-cc84389d1ea3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:45.929066 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-33e235b5-26d6-4eb2-bef3-cc84389d1ea3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1198 microversion: 2.1 time: 0.127558 Apr 05 11:24:45.939918 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 658/1343] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:45 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1198 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:46.660767 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-396ff5a6-0532-4130-b929-9678fa8120cf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:46.661906 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-396ff5a6-0532-4130-b929-9678fa8120cf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:46.673696 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-396ff5a6-0532-4130-b929-9678fa8120cf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:46.674477 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-396ff5a6-0532-4130-b929-9678fa8120cf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:46.675883 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-396ff5a6-0532-4130-b929-9678fa8120cf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:46.677110 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-396ff5a6-0532-4130-b929-9678fa8120cf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:46.947033 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2839bd96-07f0-45c5-a51b-b66d89677e79 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:46.947579 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2839bd96-07f0-45c5-a51b-b66d89677e79 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:46.954696 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2839bd96-07f0-45c5-a51b-b66d89677e79 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:46.955517 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2839bd96-07f0-45c5-a51b-b66d89677e79 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:46.956510 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2839bd96-07f0-45c5-a51b-b66d89677e79 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:46.957133 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2839bd96-07f0-45c5-a51b-b66d89677e79 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:47.113514 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-396ff5a6-0532-4130-b929-9678fa8120cf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:47.122030 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-396ff5a6-0532-4130-b929-9678fa8120cf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:47.128094 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-396ff5a6-0532-4130-b929-9678fa8120cf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:47.129309 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-396ff5a6-0532-4130-b929-9678fa8120cf tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1730 microversion: 2.20 time: 0.476960 Apr 05 11:24:47.136123 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 686/1344] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:46 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1730 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:47.300982 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2839bd96-07f0-45c5-a51b-b66d89677e79 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:47.309469 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2839bd96-07f0-45c5-a51b-b66d89677e79 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1275 microversion: 2.1 time: 0.366350 Apr 05 11:24:47.321063 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 659/1345] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:46 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1275 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:47.385795 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6dc77d74-9fa7-4b68-b7bf-b55904e54a3d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:47.386366 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6dc77d74-9fa7-4b68-b7bf-b55904e54a3d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:47.392786 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6dc77d74-9fa7-4b68-b7bf-b55904e54a3d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:47.393609 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6dc77d74-9fa7-4b68-b7bf-b55904e54a3d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:47.394959 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6dc77d74-9fa7-4b68-b7bf-b55904e54a3d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:47.395634 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6dc77d74-9fa7-4b68-b7bf-b55904e54a3d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:47.411683 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-6dc77d74-9fa7-4b68-b7bf-b55904e54a3d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] HTTP exception thrown: Instance f5ad1a46-8a77-4def-b880-e32ca5f36db1 could not be found. Apr 05 11:24:47.413501 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6dc77d74-9fa7-4b68-b7bf-b55904e54a3d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Returning 404 to user: Instance f5ad1a46-8a77-4def-b880-e32ca5f36db1 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:24:47.414031 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6dc77d74-9fa7-4b68-b7bf-b55904e54a3d tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 404 len: 111 microversion: 2.1 time: 0.033123 Apr 05 11:24:47.415465 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 687/1346] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:24:47 2022] DELETE /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:24:47.425327 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a1d6b6e1-5847-4c93-b2c5-0462c440505a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:47.426311 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a1d6b6e1-5847-4c93-b2c5-0462c440505a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: f5ad1a46-8a77-4def-b880-e32ca5f36db1] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:47.433848 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1d6b6e1-5847-4c93-b2c5-0462c440505a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:47.435087 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1d6b6e1-5847-4c93-b2c5-0462c440505a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:47.436100 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1d6b6e1-5847-4c93-b2c5-0462c440505a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:47.436756 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1d6b6e1-5847-4c93-b2c5-0462c440505a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:47.452205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-a1d6b6e1-5847-4c93-b2c5-0462c440505a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] HTTP exception thrown: Instance f5ad1a46-8a77-4def-b880-e32ca5f36db1 could not be found. Apr 05 11:24:47.453241 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a1d6b6e1-5847-4c93-b2c5-0462c440505a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Returning 404 to user: Instance f5ad1a46-8a77-4def-b880-e32ca5f36db1 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:24:47.455508 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a1d6b6e1-5847-4c93-b2c5-0462c440505a tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1" status: 404 len: 111 microversion: 2.1 time: 0.035963 Apr 05 11:24:47.456967 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 660/1347] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:47 2022] GET /compute/v2.1/servers/f5ad1a46-8a77-4def-b880-e32ca5f36db1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:24:48.091859 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-6c92ca3c-e86f-418d-82c5-c162b5cc0b98 req-5a2e60db-04cb-40b9-ad20-dc0f892c20dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "341c39fa-78c6-4a88-88a4-24c130ec377d", "tag": "42ed496a-3344-4417-81b6-eec909ddf26d"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:24:48.106010 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-6c92ca3c-e86f-418d-82c5-c162b5cc0b98 req-5a2e60db-04cb-40b9-ad20-dc0f892c20dd service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:48.107537 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-6c92ca3c-e86f-418d-82c5-c162b5cc0b98 req-5a2e60db-04cb-40b9-ad20-dc0f892c20dd service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:48.135730 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-6c92ca3c-e86f-418d-82c5-c162b5cc0b98 req-5a2e60db-04cb-40b9-ad20-dc0f892c20dd service nova] Creating event network-changed:42ed496a-3344-4417-81b6-eec909ddf26d for instance 341c39fa-78c6-4a88-88a4-24c130ec377d on hv-cinder-81899 Apr 05 11:24:48.159104 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cd1387f6-f6c7-4656-b5d0-f9d3a30170dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:48.160171 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cd1387f6-f6c7-4656-b5d0-f9d3a30170dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:48.167661 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-6c92ca3c-e86f-418d-82c5-c162b5cc0b98 req-5a2e60db-04cb-40b9-ad20-dc0f892c20dd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083003 Apr 05 11:24:48.180414 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 688/1348] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:24:48.181305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd1387f6-f6c7-4656-b5d0-f9d3a30170dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:48.181305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd1387f6-f6c7-4656-b5d0-f9d3a30170dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:48.181305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd1387f6-f6c7-4656-b5d0-f9d3a30170dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:48.181305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd1387f6-f6c7-4656-b5d0-f9d3a30170dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:48.328992 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3599ec17-570f-4cd1-abb4-7b3876c9b75c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:48.330369 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3599ec17-570f-4cd1-abb4-7b3876c9b75c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:48.340367 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3599ec17-570f-4cd1-abb4-7b3876c9b75c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:48.345601 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3599ec17-570f-4cd1-abb4-7b3876c9b75c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:48.352576 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3599ec17-570f-4cd1-abb4-7b3876c9b75c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:48.352576 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3599ec17-570f-4cd1-abb4-7b3876c9b75c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:48.433782 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cd1387f6-f6c7-4656-b5d0-f9d3a30170dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:48.442972 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cd1387f6-f6c7-4656-b5d0-f9d3a30170dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:48.444672 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cd1387f6-f6c7-4656-b5d0-f9d3a30170dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:48.446099 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cd1387f6-f6c7-4656-b5d0-f9d3a30170dc tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1717 microversion: 2.20 time: 0.295633 Apr 05 11:24:48.447417 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 661/1349] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:24:48 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1717 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:24:48.691935 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3599ec17-570f-4cd1-abb4-7b3876c9b75c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:48.700331 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3599ec17-570f-4cd1-abb4-7b3876c9b75c tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1263 microversion: 2.1 time: 0.375719 Apr 05 11:24:48.700945 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 689/1350] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:48 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1263 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:48.853007 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-81e08ab7-1bd4-4e52-a4c5-32537b350832 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:48.853597 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-81e08ab7-1bd4-4e52-a4c5-32537b350832 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:48.864876 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-81e08ab7-1bd4-4e52-a4c5-32537b350832 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:48.865343 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-81e08ab7-1bd4-4e52-a4c5-32537b350832 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:48.866456 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-81e08ab7-1bd4-4e52-a4c5-32537b350832 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:48.866831 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-81e08ab7-1bd4-4e52-a4c5-32537b350832 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:48.882206 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-81e08ab7-1bd4-4e52-a4c5-32537b350832 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] HTTP exception thrown: Instance a98ab2b1-5651-42f4-b1f3-de4469d542ad could not be found. Apr 05 11:24:48.882836 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-81e08ab7-1bd4-4e52-a4c5-32537b350832 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Returning 404 to user: Instance a98ab2b1-5651-42f4-b1f3-de4469d542ad could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:24:48.883673 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-81e08ab7-1bd4-4e52-a4c5-32537b350832 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 404 len: 111 microversion: 2.1 time: 0.034881 Apr 05 11:24:48.884236 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 662/1351] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:24:48 2022] DELETE /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:24:48.892931 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b562e835-2927-4e8c-8046-fc5a4175b473 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:48.893611 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b562e835-2927-4e8c-8046-fc5a4175b473 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] [instance: a98ab2b1-5651-42f4-b1f3-de4469d542ad] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:48.900463 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b562e835-2927-4e8c-8046-fc5a4175b473 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:48.900858 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b562e835-2927-4e8c-8046-fc5a4175b473 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:48.901626 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b562e835-2927-4e8c-8046-fc5a4175b473 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:48.902096 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b562e835-2927-4e8c-8046-fc5a4175b473 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:48.915246 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-b562e835-2927-4e8c-8046-fc5a4175b473 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] HTTP exception thrown: Instance a98ab2b1-5651-42f4-b1f3-de4469d542ad could not be found. Apr 05 11:24:48.915770 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b562e835-2927-4e8c-8046-fc5a4175b473 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] Returning 404 to user: Instance a98ab2b1-5651-42f4-b1f3-de4469d542ad could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:24:48.916593 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b562e835-2927-4e8c-8046-fc5a4175b473 tempest-AttachVolumeTestJSON-1408317376 tempest-AttachVolumeTestJSON-1408317376-project] 10.222.0.39 "GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad" status: 404 len: 111 microversion: 2.1 time: 0.028147 Apr 05 11:24:48.917146 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 690/1352] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:48 2022] GET /compute/v2.1/servers/a98ab2b1-5651-42f4-b1f3-de4469d542ad => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:24:49.719907 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-08998944-ed98-423a-9afa-31531867ba1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:49.721528 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-08998944-ed98-423a-9afa-31531867ba1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:49.729667 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08998944-ed98-423a-9afa-31531867ba1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:49.730450 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08998944-ed98-423a-9afa-31531867ba1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:49.732407 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08998944-ed98-423a-9afa-31531867ba1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:49.735502 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08998944-ed98-423a-9afa-31531867ba1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:49.967906 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-08998944-ed98-423a-9afa-31531867ba1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:49.974419 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-08998944-ed98-423a-9afa-31531867ba1a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1263 microversion: 2.1 time: 0.259824 Apr 05 11:24:49.984970 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 663/1353] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:49 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1263 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:50.999952 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6d5f8dfe-f3b0-43af-a1e5-92b8752752a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:51.001512 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6d5f8dfe-f3b0-43af-a1e5-92b8752752a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:51.011056 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d5f8dfe-f3b0-43af-a1e5-92b8752752a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:51.013461 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d5f8dfe-f3b0-43af-a1e5-92b8752752a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:51.015352 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d5f8dfe-f3b0-43af-a1e5-92b8752752a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:51.015935 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d5f8dfe-f3b0-43af-a1e5-92b8752752a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:51.297333 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6d5f8dfe-f3b0-43af-a1e5-92b8752752a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:51.308552 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6d5f8dfe-f3b0-43af-a1e5-92b8752752a5 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1263 microversion: 2.1 time: 0.313311 Apr 05 11:24:51.309448 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 691/1354] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:50 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1263 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:52.329320 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-37df9446-a61e-4a40-ac06-3d1f2f1848de tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:52.330855 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-37df9446-a61e-4a40-ac06-3d1f2f1848de tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:52.338954 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-37df9446-a61e-4a40-ac06-3d1f2f1848de tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:52.339753 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-37df9446-a61e-4a40-ac06-3d1f2f1848de tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:52.340910 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-37df9446-a61e-4a40-ac06-3d1f2f1848de tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:52.341598 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-37df9446-a61e-4a40-ac06-3d1f2f1848de tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:52.622722 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-37df9446-a61e-4a40-ac06-3d1f2f1848de tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:52.634781 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-37df9446-a61e-4a40-ac06-3d1f2f1848de tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1263 microversion: 2.1 time: 0.312680 Apr 05 11:24:52.636047 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 664/1355] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:52 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1263 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:53.660715 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c2f98a0e-e2ae-4452-8b05-d8d11727f10b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:53.661885 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c2f98a0e-e2ae-4452-8b05-d8d11727f10b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:53.674298 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c2f98a0e-e2ae-4452-8b05-d8d11727f10b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:53.675149 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c2f98a0e-e2ae-4452-8b05-d8d11727f10b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:53.677180 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c2f98a0e-e2ae-4452-8b05-d8d11727f10b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:53.677976 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c2f98a0e-e2ae-4452-8b05-d8d11727f10b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:54.026728 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c2f98a0e-e2ae-4452-8b05-d8d11727f10b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:54.047617 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c2f98a0e-e2ae-4452-8b05-d8d11727f10b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1263 microversion: 2.1 time: 0.393824 Apr 05 11:24:54.071494 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 692/1356] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:53 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1263 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:55.090341 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d3599253-0314-4cfe-b218-2b4434d2560d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:55.091434 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d3599253-0314-4cfe-b218-2b4434d2560d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:55.098639 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3599253-0314-4cfe-b218-2b4434d2560d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:55.099178 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3599253-0314-4cfe-b218-2b4434d2560d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:55.100042 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3599253-0314-4cfe-b218-2b4434d2560d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:55.100525 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3599253-0314-4cfe-b218-2b4434d2560d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:55.318340 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d3599253-0314-4cfe-b218-2b4434d2560d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:55.337119 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d3599253-0314-4cfe-b218-2b4434d2560d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1263 microversion: 2.1 time: 0.253347 Apr 05 11:24:55.343276 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 665/1357] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:55 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1263 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:56.358085 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-de2faa63-e37b-49eb-9417-b0c3b8c846c0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:56.359336 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-de2faa63-e37b-49eb-9417-b0c3b8c846c0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:56.367240 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de2faa63-e37b-49eb-9417-b0c3b8c846c0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:56.367819 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de2faa63-e37b-49eb-9417-b0c3b8c846c0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:56.368760 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de2faa63-e37b-49eb-9417-b0c3b8c846c0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:56.369528 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-de2faa63-e37b-49eb-9417-b0c3b8c846c0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:56.668077 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-de2faa63-e37b-49eb-9417-b0c3b8c846c0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:56.683157 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-de2faa63-e37b-49eb-9417-b0c3b8c846c0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1263 microversion: 2.1 time: 0.329718 Apr 05 11:24:56.684981 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 693/1358] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:56 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1263 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:24:57.713527 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6138251b-7d38-4e03-939f-fd7a597a8cdd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:57.714213 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6138251b-7d38-4e03-939f-fd7a597a8cdd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:57.721928 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6138251b-7d38-4e03-939f-fd7a597a8cdd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:57.722438 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6138251b-7d38-4e03-939f-fd7a597a8cdd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:57.724189 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6138251b-7d38-4e03-939f-fd7a597a8cdd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:57.724915 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6138251b-7d38-4e03-939f-fd7a597a8cdd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:57.914764 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6138251b-7d38-4e03-939f-fd7a597a8cdd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:57.923814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6138251b-7d38-4e03-939f-fd7a597a8cdd tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1263 microversion: 2.1 time: 0.214557 Apr 05 11:24:57.924496 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 666/1359] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:57 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1263 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:24:58.671260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-a943f34e-eca2-4f64-a957-ca4d7c2c54c5 req-244a4c16-9f6d-4ff2-8892-afa082a8859a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341c39fa-78c6-4a88-88a4-24c130ec377d", "name": "network-vif-plugged", "status": "completed", "tag": "42ed496a-3344-4417-81b6-eec909ddf26d"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:24:58.685625 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-a943f34e-eca2-4f64-a957-ca4d7c2c54c5 req-244a4c16-9f6d-4ff2-8892-afa082a8859a service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:58.686199 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-a943f34e-eca2-4f64-a957-ca4d7c2c54c5 req-244a4c16-9f6d-4ff2-8892-afa082a8859a service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:58.701218 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-a943f34e-eca2-4f64-a957-ca4d7c2c54c5 req-244a4c16-9f6d-4ff2-8892-afa082a8859a service nova] Creating event network-vif-plugged:42ed496a-3344-4417-81b6-eec909ddf26d for instance 341c39fa-78c6-4a88-88a4-24c130ec377d on hv-cinder-81899 Apr 05 11:24:58.714023 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-a943f34e-eca2-4f64-a957-ca4d7c2c54c5 req-244a4c16-9f6d-4ff2-8892-afa082a8859a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050206 Apr 05 11:24:58.715753 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 694/1360] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:24:58.946923 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2aec92de-bb64-4816-af20-a43514b35a16 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:24:58.948184 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2aec92de-bb64-4816-af20-a43514b35a16 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:24:58.960318 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2aec92de-bb64-4816-af20-a43514b35a16 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:58.967038 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2aec92de-bb64-4816-af20-a43514b35a16 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:58.967038 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2aec92de-bb64-4816-af20-a43514b35a16 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:24:58.967038 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2aec92de-bb64-4816-af20-a43514b35a16 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:24:59.196255 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2aec92de-bb64-4816-af20-a43514b35a16 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:24:59.205437 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2aec92de-bb64-4816-af20-a43514b35a16 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1263 microversion: 2.1 time: 0.266606 Apr 05 11:24:59.206063 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 667/1361] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:24:58 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1263 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:25:00.223685 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ffb25c30-9382-4070-982c-4ea2d1a93c8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:00.224390 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ffb25c30-9382-4070-982c-4ea2d1a93c8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:00.230998 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ffb25c30-9382-4070-982c-4ea2d1a93c8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:00.231454 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ffb25c30-9382-4070-982c-4ea2d1a93c8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:00.232498 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ffb25c30-9382-4070-982c-4ea2d1a93c8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:00.232931 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ffb25c30-9382-4070-982c-4ea2d1a93c8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:00.411145 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ffb25c30-9382-4070-982c-4ea2d1a93c8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:25:00.419507 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ffb25c30-9382-4070-982c-4ea2d1a93c8b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1263 microversion: 2.1 time: 0.200670 Apr 05 11:25:00.420101 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 695/1362] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:25:00 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1263 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:25:01.437484 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-effe1ed5-602a-42b9-9331-dc1cbb6fc17b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:01.438125 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-effe1ed5-602a-42b9-9331-dc1cbb6fc17b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:01.445145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-effe1ed5-602a-42b9-9331-dc1cbb6fc17b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:01.445517 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-effe1ed5-602a-42b9-9331-dc1cbb6fc17b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:01.446292 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-effe1ed5-602a-42b9-9331-dc1cbb6fc17b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:01.446757 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-effe1ed5-602a-42b9-9331-dc1cbb6fc17b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:01.594098 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-effe1ed5-602a-42b9-9331-dc1cbb6fc17b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:25:01.601920 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-effe1ed5-602a-42b9-9331-dc1cbb6fc17b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1450 microversion: 2.1 time: 0.168332 Apr 05 11:25:01.602843 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 668/1363] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:25:01 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:25:01.619189 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-90fd102b-ff1d-41ff-8835-608ac3297703 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:01.619806 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-90fd102b-ff1d-41ff-8835-608ac3297703 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:01.626536 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90fd102b-ff1d-41ff-8835-608ac3297703 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:01.627019 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90fd102b-ff1d-41ff-8835-608ac3297703 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:01.627800 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90fd102b-ff1d-41ff-8835-608ac3297703 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:01.628234 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90fd102b-ff1d-41ff-8835-608ac3297703 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:01.777039 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-90fd102b-ff1d-41ff-8835-608ac3297703 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:25:01.785601 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-90fd102b-ff1d-41ff-8835-608ac3297703 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1450 microversion: 2.1 time: 0.170328 Apr 05 11:25:01.786390 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 696/1364] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:25:01 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:25:03.895732 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-02c4f526-c585-465e-ac6c-e94f18ff56aa req-2fd605dc-3d58-494b-b29e-87612035bb52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "341c39fa-78c6-4a88-88a4-24c130ec377d", "tag": "42ed496a-3344-4417-81b6-eec909ddf26d"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:25:03.908324 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-02c4f526-c585-465e-ac6c-e94f18ff56aa req-2fd605dc-3d58-494b-b29e-87612035bb52 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:03.908797 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-02c4f526-c585-465e-ac6c-e94f18ff56aa req-2fd605dc-3d58-494b-b29e-87612035bb52 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:03.924498 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-02c4f526-c585-465e-ac6c-e94f18ff56aa req-2fd605dc-3d58-494b-b29e-87612035bb52 service nova] Creating event network-changed:42ed496a-3344-4417-81b6-eec909ddf26d for instance 341c39fa-78c6-4a88-88a4-24c130ec377d on hv-cinder-81899 Apr 05 11:25:03.934902 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-02c4f526-c585-465e-ac6c-e94f18ff56aa req-2fd605dc-3d58-494b-b29e-87612035bb52 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047412 Apr 05 11:25:03.935543 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 669/1365] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:25:26.301286 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-05821e59-db8e-4318-af20-a233192f4296 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:26.301764 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-05821e59-db8e-4318-af20-a233192f4296 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:26.307778 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-05821e59-db8e-4318-af20-a233192f4296 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:26.308228 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-05821e59-db8e-4318-af20-a233192f4296 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:26.309083 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-05821e59-db8e-4318-af20-a233192f4296 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:26.309523 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-05821e59-db8e-4318-af20-a233192f4296 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:26.332978 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-05821e59-db8e-4318-af20-a233192f4296 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/ips" status: 200 len: 150 microversion: 2.1 time: 0.036099 Apr 05 11:25:26.333467 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 697/1366] 10.222.0.39 () {58 vars in 1247 bytes} [Tue Apr 5 11:25:26 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:25:31.152728 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8dfe2e8e-ee41-4272-9538-4ee57f67bca5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5aba02fb-bebf-4e7a-8cb8-3eaffa017d37"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:25:31.153865 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8dfe2e8e-ee41-4272-9538-4ee57f67bca5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:31.160004 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8dfe2e8e-ee41-4272-9538-4ee57f67bca5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:31.160450 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8dfe2e8e-ee41-4272-9538-4ee57f67bca5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:31.161215 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8dfe2e8e-ee41-4272-9538-4ee57f67bca5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:31.161645 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8dfe2e8e-ee41-4272-9538-4ee57f67bca5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:35.283346 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8dfe2e8e-ee41-4272-9538-4ee57f67bca5 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "POST /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.135169 Apr 05 11:25:35.284560 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 670/1367] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:25:31 2022] POST /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/os-volume_attachments => generated 194 bytes in 4137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:25:43.961024 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-79acc5c6-85dd-46c1-af2e-5be2fda08074 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:43.961932 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-79acc5c6-85dd-46c1-af2e-5be2fda08074 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:43.968315 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-79acc5c6-85dd-46c1-af2e-5be2fda08074 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:43.968682 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-79acc5c6-85dd-46c1-af2e-5be2fda08074 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:43.969465 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-79acc5c6-85dd-46c1-af2e-5be2fda08074 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:43.969902 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-79acc5c6-85dd-46c1-af2e-5be2fda08074 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:44.073197 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-79acc5c6-85dd-46c1-af2e-5be2fda08074 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lazy-loading 'services' on Instance uuid 339ba379-b00c-4220-889a-d8058c31b068 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:25:44.291224 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-79acc5c6-85dd-46c1-af2e-5be2fda08074 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/os-volume_attachments/5aba02fb-bebf-4e7a-8cb8-3eaffa017d37" status: 202 len: 0 microversion: 2.1 time: 0.334070 Apr 05 11:25:44.291964 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 698/1368] 10.222.0.39 () {58 vars in 1415 bytes} [Tue Apr 5 11:25:43 2022] DELETE /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/os-volume_attachments/5aba02fb-bebf-4e7a-8cb8-3eaffa017d37 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:25:44.301776 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-de611740-24b4-4b68-9ad7-958410a9c116 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:44.302912 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-de611740-24b4-4b68-9ad7-958410a9c116 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:44.310105 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-de611740-24b4-4b68-9ad7-958410a9c116 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:44.310548 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-de611740-24b4-4b68-9ad7-958410a9c116 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:44.311394 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-de611740-24b4-4b68-9ad7-958410a9c116 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:44.311823 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-de611740-24b4-4b68-9ad7-958410a9c116 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:44.349977 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-de611740-24b4-4b68-9ad7-958410a9c116 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053150 Apr 05 11:25:44.350732 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 671/1369] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:25:44 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:25:45.363505 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-35357515-cac7-454f-a9dd-e6601a287d44 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:45.365039 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-35357515-cac7-454f-a9dd-e6601a287d44 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:45.372149 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-35357515-cac7-454f-a9dd-e6601a287d44 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:45.372729 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-35357515-cac7-454f-a9dd-e6601a287d44 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:45.373608 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-35357515-cac7-454f-a9dd-e6601a287d44 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:45.374400 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-35357515-cac7-454f-a9dd-e6601a287d44 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:45.405727 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-35357515-cac7-454f-a9dd-e6601a287d44 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047671 Apr 05 11:25:45.406310 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 699/1370] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:25:45 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:25:46.418422 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6bb3398f-938a-42b8-be6b-0e8788223c65 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:46.419438 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6bb3398f-938a-42b8-be6b-0e8788223c65 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:46.426584 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6bb3398f-938a-42b8-be6b-0e8788223c65 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:46.427257 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6bb3398f-938a-42b8-be6b-0e8788223c65 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:46.428047 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6bb3398f-938a-42b8-be6b-0e8788223c65 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:46.428487 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6bb3398f-938a-42b8-be6b-0e8788223c65 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:46.459481 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6bb3398f-938a-42b8-be6b-0e8788223c65 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045753 Apr 05 11:25:46.460077 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 672/1371] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:25:46 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 05 11:25:46.529287 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dd2e4066-16bf-450b-8ae0-18a89b1246c3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:46.530155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dd2e4066-16bf-450b-8ae0-18a89b1246c3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:46.536678 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dd2e4066-16bf-450b-8ae0-18a89b1246c3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:46.537126 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dd2e4066-16bf-450b-8ae0-18a89b1246c3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:46.537916 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dd2e4066-16bf-450b-8ae0-18a89b1246c3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:46.538353 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dd2e4066-16bf-450b-8ae0-18a89b1246c3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:46.567395 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dd2e4066-16bf-450b-8ae0-18a89b1246c3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:25:46.913852 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dd2e4066-16bf-450b-8ae0-18a89b1246c3 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 204 len: 0 microversion: 2.1 time: 0.388264 Apr 05 11:25:46.914369 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 700/1372] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:25:46 2022] DELETE /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:25:46.922989 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9823daca-934c-4925-a3b7-756a8b543b64 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:46.923601 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9823daca-934c-4925-a3b7-756a8b543b64 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:46.931939 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9823daca-934c-4925-a3b7-756a8b543b64 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:46.934585 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9823daca-934c-4925-a3b7-756a8b543b64 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:46.934585 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9823daca-934c-4925-a3b7-756a8b543b64 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:46.934585 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9823daca-934c-4925-a3b7-756a8b543b64 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:47.077681 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9823daca-934c-4925-a3b7-756a8b543b64 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:25:47.085580 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9823daca-934c-4925-a3b7-756a8b543b64 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1682 microversion: 2.1 time: 0.166624 Apr 05 11:25:47.086157 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 673/1373] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:25:46 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:25:48.104377 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8af2ab98-3ef3-43b1-9f0f-458a80590770 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:48.105015 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8af2ab98-3ef3-43b1-9f0f-458a80590770 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:48.112594 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8af2ab98-3ef3-43b1-9f0f-458a80590770 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:48.113074 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8af2ab98-3ef3-43b1-9f0f-458a80590770 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:48.113840 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8af2ab98-3ef3-43b1-9f0f-458a80590770 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:48.114273 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8af2ab98-3ef3-43b1-9f0f-458a80590770 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:48.266667 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8af2ab98-3ef3-43b1-9f0f-458a80590770 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:25:48.274967 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8af2ab98-3ef3-43b1-9f0f-458a80590770 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1682 microversion: 2.1 time: 0.175479 Apr 05 11:25:48.275804 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 701/1374] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:25:48 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:25:49.539473 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c1f8794a-ff32-400d-9dd4-ab70544acf3a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:49.540602 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c1f8794a-ff32-400d-9dd4-ab70544acf3a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:49.552022 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1f8794a-ff32-400d-9dd4-ab70544acf3a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:49.552807 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1f8794a-ff32-400d-9dd4-ab70544acf3a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:49.554225 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1f8794a-ff32-400d-9dd4-ab70544acf3a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:49.555073 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1f8794a-ff32-400d-9dd4-ab70544acf3a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:49.734844 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c1f8794a-ff32-400d-9dd4-ab70544acf3a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:25:49.742985 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c1f8794a-ff32-400d-9dd4-ab70544acf3a tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1682 microversion: 2.1 time: 0.453156 Apr 05 11:25:49.743689 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 674/1375] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:25:49 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1682 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:25:50.767591 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-269ad695-7d3f-44d9-bc0a-ab9c9d2de461 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:50.769091 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-269ad695-7d3f-44d9-bc0a-ab9c9d2de461 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:50.776257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-269ad695-7d3f-44d9-bc0a-ab9c9d2de461 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:50.776774 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-269ad695-7d3f-44d9-bc0a-ab9c9d2de461 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:50.777665 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-269ad695-7d3f-44d9-bc0a-ab9c9d2de461 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:50.778112 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-269ad695-7d3f-44d9-bc0a-ab9c9d2de461 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:50.955802 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-269ad695-7d3f-44d9-bc0a-ab9c9d2de461 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:25:50.964390 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-269ad695-7d3f-44d9-bc0a-ab9c9d2de461 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1682 microversion: 2.1 time: 0.201097 Apr 05 11:25:50.964984 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 702/1376] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:25:50 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:25:51.326973 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-a372ed9d-1d0a-4492-9094-4af4cd225eae req-cb06d8c8-66ca-4b3d-9beb-23d0aa571ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339ba379-b00c-4220-889a-d8058c31b068", "name": "network-vif-deleted", "tag": "c79699ad-777d-4577-a688-07225906c890"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:25:51.340681 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-a372ed9d-1d0a-4492-9094-4af4cd225eae req-cb06d8c8-66ca-4b3d-9beb-23d0aa571ad0 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:51.341459 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-a372ed9d-1d0a-4492-9094-4af4cd225eae req-cb06d8c8-66ca-4b3d-9beb-23d0aa571ad0 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:51.369477 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-a372ed9d-1d0a-4492-9094-4af4cd225eae req-cb06d8c8-66ca-4b3d-9beb-23d0aa571ad0 service nova] Creating event network-vif-deleted:c79699ad-777d-4577-a688-07225906c890 for instance 339ba379-b00c-4220-889a-d8058c31b068 on hv-cinder-81899 Apr 05 11:25:51.377490 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-a372ed9d-1d0a-4492-9094-4af4cd225eae req-cb06d8c8-66ca-4b3d-9beb-23d0aa571ad0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056727 Apr 05 11:25:51.379072 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 675/1377] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:25:51.992560 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dc3abfcd-3651-46da-8509-0cf44050fd35 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:51.993766 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dc3abfcd-3651-46da-8509-0cf44050fd35 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:52.003851 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc3abfcd-3651-46da-8509-0cf44050fd35 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:52.005928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc3abfcd-3651-46da-8509-0cf44050fd35 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:52.008657 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc3abfcd-3651-46da-8509-0cf44050fd35 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:52.009345 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc3abfcd-3651-46da-8509-0cf44050fd35 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:52.080807 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc3abfcd-3651-46da-8509-0cf44050fd35 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:52.081416 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc3abfcd-3651-46da-8509-0cf44050fd35 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:52.081957 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-dc3abfcd-3651-46da-8509-0cf44050fd35 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lazy-loading 'fault' on Instance uuid 339ba379-b00c-4220-889a-d8058c31b068 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:25:52.148590 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-dc3abfcd-3651-46da-8509-0cf44050fd35 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08f7e9cf075d43b39802bbdc58cd604f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c4204bde44a1183df1338d018b1b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:25:52.159255 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dc3abfcd-3651-46da-8509-0cf44050fd35 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 200 len: 1331 microversion: 2.1 time: 0.171878 Apr 05 11:25:52.163243 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 703/1378] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:25:51 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 1331 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:25:53.180370 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-05ab7a4d-c6c3-4f52-b444-1312b5f91531 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:53.181194 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-05ab7a4d-c6c3-4f52-b444-1312b5f91531 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:53.188866 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-05ab7a4d-c6c3-4f52-b444-1312b5f91531 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:53.192894 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-05ab7a4d-c6c3-4f52-b444-1312b5f91531 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:53.192894 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-05ab7a4d-c6c3-4f52-b444-1312b5f91531 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:53.192894 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-05ab7a4d-c6c3-4f52-b444-1312b5f91531 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:53.204763 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-05ab7a4d-c6c3-4f52-b444-1312b5f91531 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Instance 339ba379-b00c-4220-889a-d8058c31b068 could not be found. Apr 05 11:25:53.205914 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-05ab7a4d-c6c3-4f52-b444-1312b5f91531 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 404 to user: Instance 339ba379-b00c-4220-889a-d8058c31b068 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:25:53.206815 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-05ab7a4d-c6c3-4f52-b444-1312b5f91531 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 404 len: 111 microversion: 2.1 time: 0.032007 Apr 05 11:25:53.207515 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 676/1379] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:25:53 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:25:53.216053 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3c7cf3ef-31c2-43ba-9121-3fb8f77a9ad0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '.version_select at 0x7fec0c3239d0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:53.269093 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3c7cf3ef-31c2-43ba-9121-3fb8f77a9ad0 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-109001977" status: 202 len: 0 microversion: 2.1 time: 0.056885 Apr 05 11:25:53.269722 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 704/1380] 10.222.0.39 () {58 vars in 1217 bytes} [Tue Apr 5 11:25:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-109001977 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:25:55.423967 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-75cd31c5-2c35-412c-bb84-bac532fa50ed tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:55.424616 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-75cd31c5-2c35-412c-bb84-bac532fa50ed tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:55.431566 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75cd31c5-2c35-412c-bb84-bac532fa50ed tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:55.432009 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75cd31c5-2c35-412c-bb84-bac532fa50ed tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:55.432809 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75cd31c5-2c35-412c-bb84-bac532fa50ed tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:55.433247 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75cd31c5-2c35-412c-bb84-bac532fa50ed tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:55.448579 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-75cd31c5-2c35-412c-bb84-bac532fa50ed tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Instance 339ba379-b00c-4220-889a-d8058c31b068 could not be found. Apr 05 11:25:55.449197 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-75cd31c5-2c35-412c-bb84-bac532fa50ed tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 404 to user: Instance 339ba379-b00c-4220-889a-d8058c31b068 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:25:55.450066 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-75cd31c5-2c35-412c-bb84-bac532fa50ed tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 404 len: 111 microversion: 2.1 time: 0.030231 Apr 05 11:25:55.450693 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 677/1381] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:25:55 2022] DELETE /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:25:55.460139 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d83d3175-2e50-4fd5-bb41-a00d40464780 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:55.460784 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d83d3175-2e50-4fd5-bb41-a00d40464780 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 339ba379-b00c-4220-889a-d8058c31b068] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:55.468769 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d83d3175-2e50-4fd5-bb41-a00d40464780 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:55.469215 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d83d3175-2e50-4fd5-bb41-a00d40464780 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:55.470080 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d83d3175-2e50-4fd5-bb41-a00d40464780 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:55.470526 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d83d3175-2e50-4fd5-bb41-a00d40464780 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:55.486756 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-d83d3175-2e50-4fd5-bb41-a00d40464780 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Instance 339ba379-b00c-4220-889a-d8058c31b068 could not be found. Apr 05 11:25:55.487384 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d83d3175-2e50-4fd5-bb41-a00d40464780 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 404 to user: Instance 339ba379-b00c-4220-889a-d8058c31b068 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:25:55.488259 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d83d3175-2e50-4fd5-bb41-a00d40464780 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068" status: 404 len: 111 microversion: 2.1 time: 0.032987 Apr 05 11:25:55.488875 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 705/1382] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:25:55 2022] GET /compute/v2.1/servers/339ba379-b00c-4220-889a-d8058c31b068 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:25:56.926839 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e0c32109-bf27-47bf-b62c-b0b404ef5b40 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:56.927383 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e0c32109-bf27-47bf-b62c-b0b404ef5b40 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:56.934008 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0c32109-bf27-47bf-b62c-b0b404ef5b40 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:56.934460 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0c32109-bf27-47bf-b62c-b0b404ef5b40 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:56.935275 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0c32109-bf27-47bf-b62c-b0b404ef5b40 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:56.935707 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0c32109-bf27-47bf-b62c-b0b404ef5b40 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:56.951212 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-e0c32109-bf27-47bf-b62c-b0b404ef5b40 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Instance 1eb84f3b-18ce-4112-96a8-e6c729c759d2 could not be found. Apr 05 11:25:56.951824 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e0c32109-bf27-47bf-b62c-b0b404ef5b40 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 404 to user: Instance 1eb84f3b-18ce-4112-96a8-e6c729c759d2 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:25:56.952702 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e0c32109-bf27-47bf-b62c-b0b404ef5b40 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 404 len: 111 microversion: 2.1 time: 0.030794 Apr 05 11:25:56.953520 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 678/1383] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:25:56 2022] DELETE /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:25:56.961706 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-14e1cefc-2d6a-475d-a4b6-a9f961d4e927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:56.963225 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-14e1cefc-2d6a-475d-a4b6-a9f961d4e927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 1eb84f3b-18ce-4112-96a8-e6c729c759d2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:56.969183 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-14e1cefc-2d6a-475d-a4b6-a9f961d4e927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:56.969633 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-14e1cefc-2d6a-475d-a4b6-a9f961d4e927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:56.970418 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-14e1cefc-2d6a-475d-a4b6-a9f961d4e927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:56.970892 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-14e1cefc-2d6a-475d-a4b6-a9f961d4e927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:56.985429 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-14e1cefc-2d6a-475d-a4b6-a9f961d4e927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Instance 1eb84f3b-18ce-4112-96a8-e6c729c759d2 could not be found. Apr 05 11:25:56.986028 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-14e1cefc-2d6a-475d-a4b6-a9f961d4e927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 404 to user: Instance 1eb84f3b-18ce-4112-96a8-e6c729c759d2 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:25:56.987430 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-14e1cefc-2d6a-475d-a4b6-a9f961d4e927 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2" status: 404 len: 111 microversion: 2.1 time: 0.029818 Apr 05 11:25:56.988003 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 706/1384] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:25:56 2022] GET /compute/v2.1/servers/1eb84f3b-18ce-4112-96a8-e6c729c759d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:25:56.996369 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4c689f83-4e59-44a0-9998-c4ef034be8f9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:56.996877 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4c689f83-4e59-44a0-9998-c4ef034be8f9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:57.003931 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c689f83-4e59-44a0-9998-c4ef034be8f9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:57.004417 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c689f83-4e59-44a0-9998-c4ef034be8f9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:57.005236 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c689f83-4e59-44a0-9998-c4ef034be8f9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:57.005676 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c689f83-4e59-44a0-9998-c4ef034be8f9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:57.019748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-4c689f83-4e59-44a0-9998-c4ef034be8f9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Instance 83911c9a-66fa-4dc2-b353-e8367ed89f27 could not be found. Apr 05 11:25:57.020459 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4c689f83-4e59-44a0-9998-c4ef034be8f9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 404 to user: Instance 83911c9a-66fa-4dc2-b353-e8367ed89f27 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:25:57.021299 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4c689f83-4e59-44a0-9998-c4ef034be8f9 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 404 len: 111 microversion: 2.1 time: 0.029096 Apr 05 11:25:57.027896 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 679/1385] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:25:56 2022] DELETE /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:25:57.033384 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-29013afc-e22a-469c-9905-f0caececca66 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:57.034246 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-29013afc-e22a-469c-9905-f0caececca66 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 83911c9a-66fa-4dc2-b353-e8367ed89f27] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:57.041038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29013afc-e22a-469c-9905-f0caececca66 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:57.041499 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29013afc-e22a-469c-9905-f0caececca66 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:57.042300 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29013afc-e22a-469c-9905-f0caececca66 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:57.042871 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29013afc-e22a-469c-9905-f0caececca66 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:57.058090 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-29013afc-e22a-469c-9905-f0caececca66 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Instance 83911c9a-66fa-4dc2-b353-e8367ed89f27 could not be found. Apr 05 11:25:57.058856 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-29013afc-e22a-469c-9905-f0caececca66 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 404 to user: Instance 83911c9a-66fa-4dc2-b353-e8367ed89f27 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:25:57.059763 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-29013afc-e22a-469c-9905-f0caececca66 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27" status: 404 len: 111 microversion: 2.1 time: 0.030613 Apr 05 11:25:57.061482 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 707/1386] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:25:57 2022] GET /compute/v2.1/servers/83911c9a-66fa-4dc2-b353-e8367ed89f27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:25:58.341235 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-83848841-3551-4975-a00e-203b6f6a26a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:58.341929 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-83848841-3551-4975-a00e-203b6f6a26a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:58.348311 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-83848841-3551-4975-a00e-203b6f6a26a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:58.348762 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-83848841-3551-4975-a00e-203b6f6a26a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:58.349529 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-83848841-3551-4975-a00e-203b6f6a26a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:58.349963 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-83848841-3551-4975-a00e-203b6f6a26a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:58.365827 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-83848841-3551-4975-a00e-203b6f6a26a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Instance 8e206c1c-372e-45c5-bb53-11d7ba0fb01f could not be found. Apr 05 11:25:58.366843 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-83848841-3551-4975-a00e-203b6f6a26a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 404 to user: Instance 8e206c1c-372e-45c5-bb53-11d7ba0fb01f could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:25:58.368241 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-83848841-3551-4975-a00e-203b6f6a26a4 tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 404 len: 111 microversion: 2.1 time: 0.030842 Apr 05 11:25:58.369180 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 680/1387] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:25:58 2022] DELETE /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:25:58.381469 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0ae8e478-5581-4a26-b7cd-4d30f45501bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:25:58.382409 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0ae8e478-5581-4a26-b7cd-4d30f45501bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] [instance: 8e206c1c-372e-45c5-bb53-11d7ba0fb01f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:25:58.392915 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ae8e478-5581-4a26-b7cd-4d30f45501bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:58.393663 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ae8e478-5581-4a26-b7cd-4d30f45501bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:58.395011 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ae8e478-5581-4a26-b7cd-4d30f45501bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:25:58.395577 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ae8e478-5581-4a26-b7cd-4d30f45501bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:25:58.411263 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-0ae8e478-5581-4a26-b7cd-4d30f45501bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] HTTP exception thrown: Instance 8e206c1c-372e-45c5-bb53-11d7ba0fb01f could not be found. Apr 05 11:25:58.411858 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0ae8e478-5581-4a26-b7cd-4d30f45501bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] Returning 404 to user: Instance 8e206c1c-372e-45c5-bb53-11d7ba0fb01f could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:25:58.412696 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0ae8e478-5581-4a26-b7cd-4d30f45501bc tempest-AttachVolumeNegativeTest-79312932 tempest-AttachVolumeNegativeTest-79312932-project] 10.222.0.39 "GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f" status: 404 len: 111 microversion: 2.1 time: 0.037891 Apr 05 11:25:58.419012 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 708/1388] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:25:58 2022] GET /compute/v2.1/servers/8e206c1c-372e-45c5-bb53-11d7ba0fb01f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:26:03.150334 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f62ce522-6a49-4a37-bbd4-d279b6203961 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:03.153953 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f62ce522-6a49-4a37-bbd4-d279b6203961 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:26:03.161820 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f62ce522-6a49-4a37-bbd4-d279b6203961 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:03.162672 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f62ce522-6a49-4a37-bbd4-d279b6203961 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:03.164213 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f62ce522-6a49-4a37-bbd4-d279b6203961 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:03.165060 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f62ce522-6a49-4a37-bbd4-d279b6203961 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:03.206042 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f62ce522-6a49-4a37-bbd4-d279b6203961 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061396 Apr 05 11:26:03.206558 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 681/1389] 10.222.0.39 () {60 vars in 1342 bytes} [Tue Apr 5 11:26:03 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:26:03.271775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8ee1fc53-0f86-4862-b88b-d559892996e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:03.272435 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8ee1fc53-0f86-4862-b88b-d559892996e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:26:03.282498 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ee1fc53-0f86-4862-b88b-d559892996e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:03.283986 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ee1fc53-0f86-4862-b88b-d559892996e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:03.285885 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ee1fc53-0f86-4862-b88b-d559892996e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:03.286184 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ee1fc53-0f86-4862-b88b-d559892996e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:03.330475 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8ee1fc53-0f86-4862-b88b-d559892996e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:26:03.771840 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8ee1fc53-0f86-4862-b88b-d559892996e4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 204 len: 0 microversion: 2.20 time: 0.503442 Apr 05 11:26:03.774344 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 709/1390] 10.222.0.39 () {60 vars in 1279 bytes} [Tue Apr 5 11:26:03 2022] DELETE /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 11:26:03.785893 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9b7c2ca1-cc7a-4fdf-bf87-361ab5674fb8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:03.786880 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9b7c2ca1-cc7a-4fdf-bf87-361ab5674fb8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:26:03.795366 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b7c2ca1-cc7a-4fdf-bf87-361ab5674fb8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:03.795366 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b7c2ca1-cc7a-4fdf-bf87-361ab5674fb8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:03.796165 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b7c2ca1-cc7a-4fdf-bf87-361ab5674fb8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:03.796868 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b7c2ca1-cc7a-4fdf-bf87-361ab5674fb8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:03.962359 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9b7c2ca1-cc7a-4fdf-bf87-361ab5674fb8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:26:03.976732 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9b7c2ca1-cc7a-4fdf-bf87-361ab5674fb8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:26:03.978463 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9b7c2ca1-cc7a-4fdf-bf87-361ab5674fb8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:26:03.980403 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9b7c2ca1-cc7a-4fdf-bf87-361ab5674fb8 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.199491 Apr 05 11:26:03.981485 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 682/1391] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:26:03 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:26:05.003059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-cde7411d-847a-4c4f-aa40-b5c67be83bc6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:05.004052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-cde7411d-847a-4c4f-aa40-b5c67be83bc6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:26:05.011041 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cde7411d-847a-4c4f-aa40-b5c67be83bc6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:05.011768 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cde7411d-847a-4c4f-aa40-b5c67be83bc6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:05.012664 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cde7411d-847a-4c4f-aa40-b5c67be83bc6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:05.013201 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cde7411d-847a-4c4f-aa40-b5c67be83bc6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:05.185257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cde7411d-847a-4c4f-aa40-b5c67be83bc6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:26:05.193961 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cde7411d-847a-4c4f-aa40-b5c67be83bc6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:26:05.195542 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cde7411d-847a-4c4f-aa40-b5c67be83bc6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:26:05.196723 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-cde7411d-847a-4c4f-aa40-b5c67be83bc6 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.199201 Apr 05 11:26:05.197301 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 710/1392] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:26:04 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:26:05.824960 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-12bb3599-98cc-4873-a493-8cf465fb1102 tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] Action: 'create', calling method: .version_select at 0x7fec0c2493a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1915921002", "metadata": {"Type": "work"}}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:05.826744 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-12bb3599-98cc-4873-a493-8cf465fb1102 tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:05.827686 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-12bb3599-98cc-4873-a493-8cf465fb1102 tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132763 Apr 05 11:26:05.828350 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 683/1393] 10.222.0.39 () {60 vars in 1155 bytes} [Tue Apr 5 11:26:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:26:05.838796 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d03e7ce8-e959-47e1-a357-be9dd6b14a56 tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] Action: 'create', calling method: .version_select at 0x7fec0c1671f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1266750898", "metadata": {"Type": "work"}}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:05.840478 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d03e7ce8-e959-47e1-a357-be9dd6b14a56 tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:05.841311 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d03e7ce8-e959-47e1-a357-be9dd6b14a56 tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006927 Apr 05 11:26:05.841892 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 711/1394] 10.222.0.39 () {60 vars in 1155 bytes} [Tue Apr 5 11:26:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:26:05.852071 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-76be3782-26c7-4a98-a439-77c4088f3197 tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] Action: 'create', calling method: .version_select at 0x7fec06f09a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-512956820", "metadata": {"Type": "work"}}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:05.854130 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-76be3782-26c7-4a98-a439-77c4088f3197 tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:05.854436 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-76be3782-26c7-4a98-a439-77c4088f3197 tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006433 Apr 05 11:26:05.855766 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 684/1395] 10.222.0.39 () {60 vars in 1155 bytes} [Tue Apr 5 11:26:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:26:05.864751 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b600a7db-4499-43d2-8d89-485fa7fec04a tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] Calling method '.version_select at 0x7fec0c1a9790>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:05.893432 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-b600a7db-4499-43d2-8d89-485fa7fec04a tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] HTTP exception thrown: Volume tempest-invalid-1137414577 could not be found. Apr 05 11:26:05.894792 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b600a7db-4499-43d2-8d89-485fa7fec04a tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] Returning 404 to user: Volume tempest-invalid-1137414577 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:05.895623 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b600a7db-4499-43d2-8d89-485fa7fec04a tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1137414577" status: 404 len: 99 microversion: 2.1 time: 0.034766 Apr 05 11:26:05.896187 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 712/1396] 10.222.0.39 () {58 vars in 1217 bytes} [Tue Apr 5 11:26:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1137414577 => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 05 11:26:05.909014 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8e3daf01-1001-4cb2-810a-25aa27c31391 tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003968 Apr 05 11:26:05.909547 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 685/1397] 10.222.0.39 () {58 vars in 1139 bytes} [Tue Apr 5 11:26:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 05 11:26:05.920770 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c3a65750-3e6e-48e0-b947-e80b44f6f94c tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003882 Apr 05 11:26:05.921293 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 713/1398] 10.222.0.39 () {58 vars in 1136 bytes} [Tue Apr 5 11:26:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 05 11:26:05.931140 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-45d674f1-61b8-4fd9-b101-eb4da337a49f tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] Calling method '.version_select at 0x7fec06f09c10>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:05.961623 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-45d674f1-61b8-4fd9-b101-eb4da337a49f tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] HTTP exception thrown: Volume e718a6b1-a83d-446e-adec-6838c9fc4b64 could not be found. Apr 05 11:26:05.962243 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-45d674f1-61b8-4fd9-b101-eb4da337a49f tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] Returning 404 to user: Volume e718a6b1-a83d-446e-adec-6838c9fc4b64 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:05.963176 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-45d674f1-61b8-4fd9-b101-eb4da337a49f tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/e718a6b1-a83d-446e-adec-6838c9fc4b64" status: 404 len: 109 microversion: 2.1 time: 0.035990 Apr 05 11:26:05.963766 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 686/1399] 10.222.0.39 () {58 vars in 1247 bytes} [Tue Apr 5 11:26:05 2022] DELETE /compute/v2.1/os-volumes/e718a6b1-a83d-446e-adec-6838c9fc4b64 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:26:05.974754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e7c6d666-1b0c-49b0-a3a3-a8ddce0018cf tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] Calling method '.version_select at 0x7fec0c167d30>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:06.002516 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-e7c6d666-1b0c-49b0-a3a3-a8ddce0018cf tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] HTTP exception thrown: Volume 7f58868b-7067-42f8-95f4-820dd7f7b197 could not be found. Apr 05 11:26:06.003172 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e7c6d666-1b0c-49b0-a3a3-a8ddce0018cf tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] Returning 404 to user: Volume 7f58868b-7067-42f8-95f4-820dd7f7b197 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:06.004009 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e7c6d666-1b0c-49b0-a3a3-a8ddce0018cf tempest-VolumesNegativeTest-1787217050 tempest-VolumesNegativeTest-1787217050-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7f58868b-7067-42f8-95f4-820dd7f7b197" status: 404 len: 109 microversion: 2.1 time: 0.034894 Apr 05 11:26:06.004574 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 714/1400] 10.222.0.39 () {58 vars in 1244 bytes} [Tue Apr 5 11:26:05 2022] GET /compute/v2.1/os-volumes/7f58868b-7067-42f8-95f4-820dd7f7b197 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:26:06.217396 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bcc6cc2a-3469-421d-851e-79abc041c3f4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:06.218119 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bcc6cc2a-3469-421d-851e-79abc041c3f4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:26:06.229662 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bcc6cc2a-3469-421d-851e-79abc041c3f4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:06.230858 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bcc6cc2a-3469-421d-851e-79abc041c3f4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:06.231900 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bcc6cc2a-3469-421d-851e-79abc041c3f4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:06.232472 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bcc6cc2a-3469-421d-851e-79abc041c3f4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:06.515316 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bcc6cc2a-3469-421d-851e-79abc041c3f4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:26:06.529433 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bcc6cc2a-3469-421d-851e-79abc041c3f4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:26:06.534279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bcc6cc2a-3469-421d-851e-79abc041c3f4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:26:06.534279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bcc6cc2a-3469-421d-851e-79abc041c3f4 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1723 microversion: 2.20 time: 0.320479 Apr 05 11:26:06.534279 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 687/1401] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:26:06 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:26:07.013428 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-db9293b0-1afc-4098-94cd-e2462ff1209e req-d0e5760d-8591-4789-8c4e-6c4ce3797f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "078668ec-0695-4717-bef7-1153cdc2dd14", "name": "network-vif-deleted", "tag": "f631937a-090e-4c88-959c-bbf9308dfac9"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:26:07.022124 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-db9293b0-1afc-4098-94cd-e2462ff1209e req-d0e5760d-8591-4789-8c4e-6c4ce3797f71 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:07.022574 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-db9293b0-1afc-4098-94cd-e2462ff1209e req-d0e5760d-8591-4789-8c4e-6c4ce3797f71 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:07.034047 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-db9293b0-1afc-4098-94cd-e2462ff1209e req-d0e5760d-8591-4789-8c4e-6c4ce3797f71 service nova] Creating event network-vif-deleted:f631937a-090e-4c88-959c-bbf9308dfac9 for instance 078668ec-0695-4717-bef7-1153cdc2dd14 on hv-cinder-81899 Apr 05 11:26:07.039257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-db9293b0-1afc-4098-94cd-e2462ff1209e req-d0e5760d-8591-4789-8c4e-6c4ce3797f71 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.288958 Apr 05 11:26:07.039865 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 715/1402] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:26:07.552717 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1313b3a4-870b-49fc-b241-a092575a8db2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:07.554139 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1313b3a4-870b-49fc-b241-a092575a8db2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:26:07.561705 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1313b3a4-870b-49fc-b241-a092575a8db2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:07.562629 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1313b3a4-870b-49fc-b241-a092575a8db2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:07.563783 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1313b3a4-870b-49fc-b241-a092575a8db2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:07.564571 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1313b3a4-870b-49fc-b241-a092575a8db2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:07.604067 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1313b3a4-870b-49fc-b241-a092575a8db2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:07.604521 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1313b3a4-870b-49fc-b241-a092575a8db2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:07.605687 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-1313b3a4-870b-49fc-b241-a092575a8db2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lazy-loading 'fault' on Instance uuid 078668ec-0695-4717-bef7-1153cdc2dd14 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:26:07.649522 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1313b3a4-870b-49fc-b241-a092575a8db2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:26:07.661498 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1313b3a4-870b-49fc-b241-a092575a8db2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:26:07.663410 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1313b3a4-870b-49fc-b241-a092575a8db2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80261d844de047b18aa2ae70dbc3a4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee45cad25b8c4845b2cf9c11ab2dd7c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:26:07.664957 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1313b3a4-870b-49fc-b241-a092575a8db2 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 200 len: 1370 microversion: 2.20 time: 0.116869 Apr 05 11:26:07.665737 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 688/1403] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:26:07 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 1370 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 11:26:08.693754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7222789d-4e0b-4392-87b4-03aa4140931e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:08.695077 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7222789d-4e0b-4392-87b4-03aa4140931e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:26:08.707234 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7222789d-4e0b-4392-87b4-03aa4140931e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:08.707970 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7222789d-4e0b-4392-87b4-03aa4140931e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:08.708909 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7222789d-4e0b-4392-87b4-03aa4140931e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:08.709617 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7222789d-4e0b-4392-87b4-03aa4140931e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:08.727899 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-7222789d-4e0b-4392-87b4-03aa4140931e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] HTTP exception thrown: Instance 078668ec-0695-4717-bef7-1153cdc2dd14 could not be found. Apr 05 11:26:08.728509 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7222789d-4e0b-4392-87b4-03aa4140931e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Returning 404 to user: Instance 078668ec-0695-4717-bef7-1153cdc2dd14 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:08.729363 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7222789d-4e0b-4392-87b4-03aa4140931e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 404 len: 111 microversion: 2.20 time: 0.044435 Apr 05 11:26:08.730731 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 716/1404] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:26:08 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 05 11:26:08.738964 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-02a20d73-6139-4d49-bf7e-71f4157c4b48 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '.version_select at 0x7fec0c03b940>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:08.869692 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-02a20d73-6139-4d49-bf7e-71f4157c4b48 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-776424965" status: 204 len: 0 microversion: 2.20 time: 0.134594 Apr 05 11:26:08.870575 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 689/1405] 10.222.0.39 () {60 vars in 1258 bytes} [Tue Apr 5 11:26:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-776424965 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 11:26:11.182400 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-29887739-53cd-4248-bbcf-eba6880c6b05 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:11.183022 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-29887739-53cd-4248-bbcf-eba6880c6b05 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:26:11.190727 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29887739-53cd-4248-bbcf-eba6880c6b05 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:11.193803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29887739-53cd-4248-bbcf-eba6880c6b05 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:11.193803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29887739-53cd-4248-bbcf-eba6880c6b05 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:11.193803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29887739-53cd-4248-bbcf-eba6880c6b05 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:11.207306 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-29887739-53cd-4248-bbcf-eba6880c6b05 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] HTTP exception thrown: Instance 078668ec-0695-4717-bef7-1153cdc2dd14 could not be found. Apr 05 11:26:11.207825 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-29887739-53cd-4248-bbcf-eba6880c6b05 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Returning 404 to user: Instance 078668ec-0695-4717-bef7-1153cdc2dd14 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:11.208712 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-29887739-53cd-4248-bbcf-eba6880c6b05 tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 404 len: 111 microversion: 2.20 time: 0.030433 Apr 05 11:26:11.209302 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 717/1406] 10.222.0.39 () {60 vars in 1279 bytes} [Tue Apr 5 11:26:11 2022] DELETE /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:26:11.218451 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dc8cb081-31eb-48ec-a1cc-0e6590bacdea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:11.219247 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dc8cb081-31eb-48ec-a1cc-0e6590bacdea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: 078668ec-0695-4717-bef7-1153cdc2dd14] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:26:11.226477 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dc8cb081-31eb-48ec-a1cc-0e6590bacdea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:11.226972 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dc8cb081-31eb-48ec-a1cc-0e6590bacdea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:11.227808 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dc8cb081-31eb-48ec-a1cc-0e6590bacdea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:11.228262 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dc8cb081-31eb-48ec-a1cc-0e6590bacdea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:11.243696 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-dc8cb081-31eb-48ec-a1cc-0e6590bacdea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] HTTP exception thrown: Instance 078668ec-0695-4717-bef7-1153cdc2dd14 could not be found. Apr 05 11:26:11.244294 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dc8cb081-31eb-48ec-a1cc-0e6590bacdea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Returning 404 to user: Instance 078668ec-0695-4717-bef7-1153cdc2dd14 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:11.245135 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dc8cb081-31eb-48ec-a1cc-0e6590bacdea tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14" status: 404 len: 111 microversion: 2.20 time: 0.031431 Apr 05 11:26:11.245709 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 690/1407] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:26:11 2022] GET /compute/v2.1/servers/078668ec-0695-4717-bef7-1153cdc2dd14 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:26:12.573113 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2b5ddbfb-4661-4766-9a2b-dbda6551537e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:12.574026 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2b5ddbfb-4661-4766-9a2b-dbda6551537e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:26:12.581614 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b5ddbfb-4661-4766-9a2b-dbda6551537e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:12.582076 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b5ddbfb-4661-4766-9a2b-dbda6551537e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:12.583169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b5ddbfb-4661-4766-9a2b-dbda6551537e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:12.583614 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b5ddbfb-4661-4766-9a2b-dbda6551537e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:12.597198 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-2b5ddbfb-4661-4766-9a2b-dbda6551537e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] HTTP exception thrown: Instance c900362d-904b-4d64-a9a3-ab381ca756e3 could not be found. Apr 05 11:26:12.597791 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2b5ddbfb-4661-4766-9a2b-dbda6551537e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Returning 404 to user: Instance c900362d-904b-4d64-a9a3-ab381ca756e3 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:12.598646 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2b5ddbfb-4661-4766-9a2b-dbda6551537e tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 404 len: 111 microversion: 2.20 time: 0.029514 Apr 05 11:26:12.599182 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 718/1408] 10.222.0.39 () {60 vars in 1279 bytes} [Tue Apr 5 11:26:12 2022] DELETE /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:26:12.607548 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-89e6e0df-078a-4098-a50b-d6cebd47ba8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:26:12.608242 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-89e6e0df-078a-4098-a50b-d6cebd47ba8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] [instance: c900362d-904b-4d64-a9a3-ab381ca756e3] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:26:12.615271 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89e6e0df-078a-4098-a50b-d6cebd47ba8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:12.615724 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89e6e0df-078a-4098-a50b-d6cebd47ba8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:12.616512 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89e6e0df-078a-4098-a50b-d6cebd47ba8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:26:12.616951 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89e6e0df-078a-4098-a50b-d6cebd47ba8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:26:12.631364 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-89e6e0df-078a-4098-a50b-d6cebd47ba8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] HTTP exception thrown: Instance c900362d-904b-4d64-a9a3-ab381ca756e3 could not be found. Apr 05 11:26:12.631992 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-89e6e0df-078a-4098-a50b-d6cebd47ba8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] Returning 404 to user: Instance c900362d-904b-4d64-a9a3-ab381ca756e3 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:26:12.632822 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-89e6e0df-078a-4098-a50b-d6cebd47ba8a tempest-AttachVolumeShelveTestJSON-1598261819 tempest-AttachVolumeShelveTestJSON-1598261819-project] 10.222.0.39 "GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3" status: 404 len: 111 microversion: 2.20 time: 0.029434 Apr 05 11:26:12.633387 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 691/1409] 10.222.0.39 () {60 vars in 1276 bytes} [Tue Apr 5 11:26:12 2022] GET /compute/v2.1/servers/c900362d-904b-4d64-a9a3-ab381ca756e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 11:26:47.031803 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:26:47.032419 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: Tue Apr 5 11:26:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:27:09.638197 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:27:09.638813 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: Tue Apr 5 11:27:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:27:19.491746 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1863203871", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-72033448", "security_groups": [{"name": "tempest-secgroup-smoke-300189603"}], "block_device_mapping_v2": [{"uuid": "d649472e-752d-42bd-ae87-16051fe7e5d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "15ec88ec-a078-4d94-a658-456bc06f4f38"}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:27:19.606203 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] validate_networks() for [('15ec88ec-a078-4d94-a658-456bc06f4f38', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:27:20.139757 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:27:20.140189 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:27:20.140698 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:27:20.141201 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:27:20.141557 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:27:20.150374 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:20.150860 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:20.151685 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:20.152110 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:20.168801 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Getting quotas for project 0c1827315aac4bfdacff856a13f90eb5. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:27:20.173354 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Getting quotas for user 068fa3223349449db508a275fa38ffdb and project 0c1827315aac4bfdacff856a13f90eb5. Resources: {'instances', 'cores', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:27:20.232685 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:27:20.235380 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d649472e-752d-42bd-ae87-16051fe7e5d3',volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:27:20.657469 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b39e52c1-4f95-4222-8830-3de7ed77f502 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.170582 Apr 05 11:27:20.658195 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 719/1410] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:27:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:27:20.669379 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8446cca4-218a-4745-9577-72bc2e6f88d8 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:20.670583 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8446cca4-218a-4745-9577-72bc2e6f88d8 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:20.727408 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8446cca4-218a-4745-9577-72bc2e6f88d8 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:20.739391 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8446cca4-218a-4745-9577-72bc2e6f88d8 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1093 microversion: 2.1 time: 0.074965 Apr 05 11:27:20.740195 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 692/1411] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:20 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:21.757556 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bf57e8ed-8357-4b1d-a518-9ce8a5d2412e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:21.758147 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bf57e8ed-8357-4b1d-a518-9ce8a5d2412e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:21.809659 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bf57e8ed-8357-4b1d-a518-9ce8a5d2412e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:21.816630 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bf57e8ed-8357-4b1d-a518-9ce8a5d2412e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1093 microversion: 2.1 time: 0.063709 Apr 05 11:27:21.817198 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 720/1412] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:21 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:22.834165 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1685818d-c1e0-44b3-9bcd-9e05bea8a67b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:22.835303 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1685818d-c1e0-44b3-9bcd-9e05bea8a67b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:22.844384 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1685818d-c1e0-44b3-9bcd-9e05bea8a67b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:22.845094 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1685818d-c1e0-44b3-9bcd-9e05bea8a67b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:22.846497 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1685818d-c1e0-44b3-9bcd-9e05bea8a67b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:22.847054 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1685818d-c1e0-44b3-9bcd-9e05bea8a67b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:22.916153 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1685818d-c1e0-44b3-9bcd-9e05bea8a67b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:22.923648 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1685818d-c1e0-44b3-9bcd-9e05bea8a67b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1191 microversion: 2.1 time: 0.093523 Apr 05 11:27:22.924220 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 693/1413] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:22 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:23.940837 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8ba6e1a6-8ad8-4f2b-9e62-8a4b6337fefb tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:23.941481 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8ba6e1a6-8ad8-4f2b-9e62-8a4b6337fefb tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:23.948933 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ba6e1a6-8ad8-4f2b-9e62-8a4b6337fefb tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:23.949377 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ba6e1a6-8ad8-4f2b-9e62-8a4b6337fefb tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:23.950175 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ba6e1a6-8ad8-4f2b-9e62-8a4b6337fefb tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:23.950638 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8ba6e1a6-8ad8-4f2b-9e62-8a4b6337fefb tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:24.017403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8ba6e1a6-8ad8-4f2b-9e62-8a4b6337fefb tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:24.025282 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8ba6e1a6-8ad8-4f2b-9e62-8a4b6337fefb tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1209 microversion: 2.1 time: 0.088366 Apr 05 11:27:24.025890 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 721/1414] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:23 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:25.043500 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b0ce7d59-c2e9-4da8-a136-7e43095d984a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:25.044116 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b0ce7d59-c2e9-4da8-a136-7e43095d984a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:25.050997 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b0ce7d59-c2e9-4da8-a136-7e43095d984a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:25.051381 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b0ce7d59-c2e9-4da8-a136-7e43095d984a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:25.052439 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b0ce7d59-c2e9-4da8-a136-7e43095d984a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:25.052807 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b0ce7d59-c2e9-4da8-a136-7e43095d984a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:25.175929 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-c77b4b0f-2077-4258-9512-b1db7f2d3294 req-bc99c874-ca90-4924-aabb-bd6c5537f514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4de53323-ab77-461a-aeea-8cdf6fe059f6", "tag": "91a37f0f-bb87-45a8-b411-406bb0d3d30f"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:27:25.190126 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c77b4b0f-2077-4258-9512-b1db7f2d3294 req-bc99c874-ca90-4924-aabb-bd6c5537f514 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:25.190565 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c77b4b0f-2077-4258-9512-b1db7f2d3294 req-bc99c874-ca90-4924-aabb-bd6c5537f514 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:25.211279 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-c77b4b0f-2077-4258-9512-b1db7f2d3294 req-bc99c874-ca90-4924-aabb-bd6c5537f514 service nova] Creating event network-changed:91a37f0f-bb87-45a8-b411-406bb0d3d30f for instance 4de53323-ab77-461a-aeea-8cdf6fe059f6 on hv-cinder-81899 Apr 05 11:27:25.216829 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-c77b4b0f-2077-4258-9512-b1db7f2d3294 req-bc99c874-ca90-4924-aabb-bd6c5537f514 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046022 Apr 05 11:27:25.217925 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 722/1415] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:27:25.292342 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b0ce7d59-c2e9-4da8-a136-7e43095d984a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:25.303048 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b0ce7d59-c2e9-4da8-a136-7e43095d984a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1264 microversion: 2.1 time: 0.263336 Apr 05 11:27:25.303809 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 694/1416] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:25 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1264 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:26.320847 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-357ec982-46e7-4886-aa6a-9446bdcc343a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:26.322211 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-357ec982-46e7-4886-aa6a-9446bdcc343a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:26.329160 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-357ec982-46e7-4886-aa6a-9446bdcc343a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:26.330184 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-357ec982-46e7-4886-aa6a-9446bdcc343a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:26.331155 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-357ec982-46e7-4886-aa6a-9446bdcc343a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:26.331738 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-357ec982-46e7-4886-aa6a-9446bdcc343a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:26.482072 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-357ec982-46e7-4886-aa6a-9446bdcc343a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:26.494491 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-357ec982-46e7-4886-aa6a-9446bdcc343a tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1264 microversion: 2.1 time: 0.178125 Apr 05 11:27:26.495125 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 723/1417] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:26 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:27.511735 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-db939930-1be9-47e9-b5b1-61d32195b25d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:27.512366 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-db939930-1be9-47e9-b5b1-61d32195b25d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:27.519860 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-db939930-1be9-47e9-b5b1-61d32195b25d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:27.520476 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-db939930-1be9-47e9-b5b1-61d32195b25d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:27.521350 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-db939930-1be9-47e9-b5b1-61d32195b25d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:27.521764 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-db939930-1be9-47e9-b5b1-61d32195b25d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:27.660015 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-db939930-1be9-47e9-b5b1-61d32195b25d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:27.671798 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-db939930-1be9-47e9-b5b1-61d32195b25d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1264 microversion: 2.1 time: 0.163507 Apr 05 11:27:27.672818 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 695/1418] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:27 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:27:28.690188 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d2d3dd26-06e3-4fcc-92f6-60022cfe41d9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:28.690837 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d2d3dd26-06e3-4fcc-92f6-60022cfe41d9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:28.697638 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2d3dd26-06e3-4fcc-92f6-60022cfe41d9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:28.698091 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2d3dd26-06e3-4fcc-92f6-60022cfe41d9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:28.698898 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2d3dd26-06e3-4fcc-92f6-60022cfe41d9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:28.699424 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2d3dd26-06e3-4fcc-92f6-60022cfe41d9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:28.838857 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d2d3dd26-06e3-4fcc-92f6-60022cfe41d9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:28.847508 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d2d3dd26-06e3-4fcc-92f6-60022cfe41d9 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1264 microversion: 2.1 time: 0.161942 Apr 05 11:27:28.848287 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 724/1419] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:28 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:29.865164 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b7be5d47-3136-402d-a436-0820d0f05fc7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:29.865755 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b7be5d47-3136-402d-a436-0820d0f05fc7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:29.872364 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b7be5d47-3136-402d-a436-0820d0f05fc7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:29.872843 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b7be5d47-3136-402d-a436-0820d0f05fc7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:29.873628 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b7be5d47-3136-402d-a436-0820d0f05fc7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:29.874072 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b7be5d47-3136-402d-a436-0820d0f05fc7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:30.017853 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b7be5d47-3136-402d-a436-0820d0f05fc7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:30.025768 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b7be5d47-3136-402d-a436-0820d0f05fc7 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1264 microversion: 2.1 time: 0.164295 Apr 05 11:27:30.026339 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 696/1420] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:29 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:31.042789 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-09145400-5ef3-4238-954f-6b2f76314c5d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:31.043521 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-09145400-5ef3-4238-954f-6b2f76314c5d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:31.050953 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09145400-5ef3-4238-954f-6b2f76314c5d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:31.051408 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09145400-5ef3-4238-954f-6b2f76314c5d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:31.052310 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09145400-5ef3-4238-954f-6b2f76314c5d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:31.052749 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09145400-5ef3-4238-954f-6b2f76314c5d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:31.190520 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-09145400-5ef3-4238-954f-6b2f76314c5d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:31.198171 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-09145400-5ef3-4238-954f-6b2f76314c5d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1264 microversion: 2.1 time: 0.159295 Apr 05 11:27:31.198766 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 725/1421] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:31 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:32.215408 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ae1e1abf-ff9d-4968-aa09-5a331a65293b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:32.216048 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ae1e1abf-ff9d-4968-aa09-5a331a65293b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:32.223404 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae1e1abf-ff9d-4968-aa09-5a331a65293b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:32.223951 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae1e1abf-ff9d-4968-aa09-5a331a65293b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:32.224640 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae1e1abf-ff9d-4968-aa09-5a331a65293b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:32.225075 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae1e1abf-ff9d-4968-aa09-5a331a65293b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:32.364218 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ae1e1abf-ff9d-4968-aa09-5a331a65293b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:32.372459 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ae1e1abf-ff9d-4968-aa09-5a331a65293b tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1264 microversion: 2.1 time: 0.160902 Apr 05 11:27:32.373034 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 697/1422] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:32 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:33.388592 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b6352f02-4f08-43e1-8aab-afa7bbd7c0ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:33.389126 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b6352f02-4f08-43e1-8aab-afa7bbd7c0ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:33.395695 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6352f02-4f08-43e1-8aab-afa7bbd7c0ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:33.396150 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6352f02-4f08-43e1-8aab-afa7bbd7c0ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:33.396924 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6352f02-4f08-43e1-8aab-afa7bbd7c0ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:33.397396 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6352f02-4f08-43e1-8aab-afa7bbd7c0ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:33.537766 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b6352f02-4f08-43e1-8aab-afa7bbd7c0ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:33.545288 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b6352f02-4f08-43e1-8aab-afa7bbd7c0ea tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1264 microversion: 2.1 time: 0.160659 Apr 05 11:27:33.545859 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 726/1423] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:33 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:34.570886 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ba50dacd-a0ba-48d9-8f7c-e2f0caf8000d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:34.571500 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ba50dacd-a0ba-48d9-8f7c-e2f0caf8000d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:34.577793 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ba50dacd-a0ba-48d9-8f7c-e2f0caf8000d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:34.578243 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ba50dacd-a0ba-48d9-8f7c-e2f0caf8000d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:34.579062 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ba50dacd-a0ba-48d9-8f7c-e2f0caf8000d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:34.579497 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ba50dacd-a0ba-48d9-8f7c-e2f0caf8000d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:34.728116 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ba50dacd-a0ba-48d9-8f7c-e2f0caf8000d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:34.736233 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ba50dacd-a0ba-48d9-8f7c-e2f0caf8000d tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1264 microversion: 2.1 time: 0.169203 Apr 05 11:27:34.736807 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 698/1424] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:34 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:35.754106 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-28a6100e-0bbd-4de2-b262-e4d6f321f2db tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:35.754693 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-28a6100e-0bbd-4de2-b262-e4d6f321f2db tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:35.761444 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-28a6100e-0bbd-4de2-b262-e4d6f321f2db tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:35.761886 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-28a6100e-0bbd-4de2-b262-e4d6f321f2db tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:35.762692 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-28a6100e-0bbd-4de2-b262-e4d6f321f2db tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:35.763125 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-28a6100e-0bbd-4de2-b262-e4d6f321f2db tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:35.904299 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-28a6100e-0bbd-4de2-b262-e4d6f321f2db tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:35.912247 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-28a6100e-0bbd-4de2-b262-e4d6f321f2db tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1264 microversion: 2.1 time: 0.162648 Apr 05 11:27:35.912929 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 727/1425] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:35 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:36.929230 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-25f404c1-652c-410d-be87-316fa6889f7e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:36.929944 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-25f404c1-652c-410d-be87-316fa6889f7e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:36.936078 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-25f404c1-652c-410d-be87-316fa6889f7e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:36.936526 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-25f404c1-652c-410d-be87-316fa6889f7e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:36.937776 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-25f404c1-652c-410d-be87-316fa6889f7e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:36.938205 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-25f404c1-652c-410d-be87-316fa6889f7e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:37.082391 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-25f404c1-652c-410d-be87-316fa6889f7e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:37.090270 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-25f404c1-652c-410d-be87-316fa6889f7e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1264 microversion: 2.1 time: 0.164830 Apr 05 11:27:37.090902 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 699/1426] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:36 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:37.463315 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-2e29ef9b-bc63-4efa-9178-200771d4da85 req-15fffc62-1196-4f17-9ff5-956c4ba3360d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de53323-ab77-461a-aeea-8cdf6fe059f6", "name": "network-vif-plugged", "status": "completed", "tag": "91a37f0f-bb87-45a8-b411-406bb0d3d30f"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:27:37.472398 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-2e29ef9b-bc63-4efa-9178-200771d4da85 req-15fffc62-1196-4f17-9ff5-956c4ba3360d service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:37.472840 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-2e29ef9b-bc63-4efa-9178-200771d4da85 req-15fffc62-1196-4f17-9ff5-956c4ba3360d service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:37.487751 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-2e29ef9b-bc63-4efa-9178-200771d4da85 req-15fffc62-1196-4f17-9ff5-956c4ba3360d service nova] Creating event network-vif-plugged:91a37f0f-bb87-45a8-b411-406bb0d3d30f for instance 4de53323-ab77-461a-aeea-8cdf6fe059f6 on hv-cinder-81899 Apr 05 11:27:37.492842 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-2e29ef9b-bc63-4efa-9178-200771d4da85 req-15fffc62-1196-4f17-9ff5-956c4ba3360d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033278 Apr 05 11:27:37.493450 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 728/1427] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:27:38.107542 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0d9c4209-d1fe-4d7e-a665-cad6003be6f3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:38.108093 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0d9c4209-d1fe-4d7e-a665-cad6003be6f3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:38.114437 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0d9c4209-d1fe-4d7e-a665-cad6003be6f3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:38.114924 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0d9c4209-d1fe-4d7e-a665-cad6003be6f3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:38.115697 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0d9c4209-d1fe-4d7e-a665-cad6003be6f3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:38.116138 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0d9c4209-d1fe-4d7e-a665-cad6003be6f3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:38.253723 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0d9c4209-d1fe-4d7e-a665-cad6003be6f3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:38.261308 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0d9c4209-d1fe-4d7e-a665-cad6003be6f3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1264 microversion: 2.1 time: 0.157682 Apr 05 11:27:38.262064 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 700/1428] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:38 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:39.279208 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d3c21b8e-5f52-4116-a632-90ab9d6fc451 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:39.279901 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d3c21b8e-5f52-4116-a632-90ab9d6fc451 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:39.286863 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3c21b8e-5f52-4116-a632-90ab9d6fc451 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:39.287643 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3c21b8e-5f52-4116-a632-90ab9d6fc451 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:39.288438 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3c21b8e-5f52-4116-a632-90ab9d6fc451 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:39.288871 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3c21b8e-5f52-4116-a632-90ab9d6fc451 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:39.432612 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d3c21b8e-5f52-4116-a632-90ab9d6fc451 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:39.441389 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d3c21b8e-5f52-4116-a632-90ab9d6fc451 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1264 microversion: 2.1 time: 0.166692 Apr 05 11:27:39.441978 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 729/1429] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:39 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:40.458458 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a5170b85-dd95-4789-a544-fccc4f28ff7f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:40.459091 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a5170b85-dd95-4789-a544-fccc4f28ff7f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:40.466499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5170b85-dd95-4789-a544-fccc4f28ff7f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:40.467147 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5170b85-dd95-4789-a544-fccc4f28ff7f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:40.468064 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5170b85-dd95-4789-a544-fccc4f28ff7f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:40.469268 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5170b85-dd95-4789-a544-fccc4f28ff7f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:40.604609 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a5170b85-dd95-4789-a544-fccc4f28ff7f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:40.615542 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a5170b85-dd95-4789-a544-fccc4f28ff7f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1451 microversion: 2.1 time: 0.160653 Apr 05 11:27:40.616177 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 701/1430] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:40 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:40.632180 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9cec6bbf-464a-4e2a-9fa2-418d535d4e77 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:27:40.637132 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9cec6bbf-464a-4e2a-9fa2-418d535d4e77 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:27:40.639261 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9cec6bbf-464a-4e2a-9fa2-418d535d4e77 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:40.639711 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9cec6bbf-464a-4e2a-9fa2-418d535d4e77 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:40.640555 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9cec6bbf-464a-4e2a-9fa2-418d535d4e77 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:40.640992 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9cec6bbf-464a-4e2a-9fa2-418d535d4e77 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:40.777595 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9cec6bbf-464a-4e2a-9fa2-418d535d4e77 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:27:40.785516 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9cec6bbf-464a-4e2a-9fa2-418d535d4e77 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1451 microversion: 2.1 time: 0.157125 Apr 05 11:27:40.786078 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 730/1431] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:27:40 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:27:43.144609 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-c52d462d-1865-4801-a86f-a72a1bd52e9c req-90ee1790-daa8-43f7-9c58-be86cce955f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4de53323-ab77-461a-aeea-8cdf6fe059f6", "tag": "91a37f0f-bb87-45a8-b411-406bb0d3d30f"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:27:43.153516 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-c52d462d-1865-4801-a86f-a72a1bd52e9c req-90ee1790-daa8-43f7-9c58-be86cce955f5 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:27:43.153962 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-c52d462d-1865-4801-a86f-a72a1bd52e9c req-90ee1790-daa8-43f7-9c58-be86cce955f5 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:27:43.165106 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-c52d462d-1865-4801-a86f-a72a1bd52e9c req-90ee1790-daa8-43f7-9c58-be86cce955f5 service nova] Creating event network-changed:91a37f0f-bb87-45a8-b411-406bb0d3d30f for instance 4de53323-ab77-461a-aeea-8cdf6fe059f6 on hv-cinder-81899 Apr 05 11:27:43.170223 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-c52d462d-1865-4801-a86f-a72a1bd52e9c req-90ee1790-daa8-43f7-9c58-be86cce955f5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030565 Apr 05 11:27:43.170866 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 702/1432] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:28:25.988613 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:28:25.989275 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: Tue Apr 5 11:28:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:28:33.851373 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:28:33.851976 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: Tue Apr 5 11:28:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:28:34.782003 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a9c6f841-95a9-47dc-996c-58c05e65cde5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Action: 'create', calling method: .version_select at 0x7fec0c192790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1906045848"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:28:34.796046 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-a9c6f841-95a9-47dc-996c-58c05e65cde5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Getting quotas for project 220a2c61da3646bc944112302aec29c4. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:28:34.799844 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-a9c6f841-95a9-47dc-996c-58c05e65cde5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Getting quotas for user 480e8207885a4342a1db97ca5a194b63 and project 220a2c61da3646bc944112302aec29c4. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:28:35.143940 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-a9c6f841-95a9-47dc-996c-58c05e65cde5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Getting quotas for project 220a2c61da3646bc944112302aec29c4. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:28:35.148034 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-a9c6f841-95a9-47dc-996c-58c05e65cde5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Getting quotas for user 480e8207885a4342a1db97ca5a194b63 and project 220a2c61da3646bc944112302aec29c4. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:28:35.161526 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a9c6f841-95a9-47dc-996c-58c05e65cde5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.384242 Apr 05 11:28:35.162128 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 731/1433] 10.222.0.39 () {60 vars in 1157 bytes} [Tue Apr 5 11:28:34 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:28:35.211297 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1074935787", "imageRef": "7769489d-4a72-4210-b754-404eec0fc422", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1906045848", "networks": [{"uuid": "bc9b9e66-4b5a-4b8f-b37b-228826d454e8"}]}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:28:35.392544 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] validate_networks() for [('bc9b9e66-4b5a-4b8f-b37b-228826d454e8', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 05 11:28:35.862902 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 05 11:28:35.863368 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 11:28:35.863870 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 05 11:28:35.864277 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 11:28:35.864753 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 05 11:28:35.873478 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:35.873974 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:35.874829 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:35.875266 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:35.892885 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Getting quotas for project 220a2c61da3646bc944112302aec29c4. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 05 11:28:35.896825 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Getting quotas for user 480e8207885a4342a1db97ca5a194b63 and project 220a2c61da3646bc944112302aec29c4. Resources: {'instances', 'cores', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 05 11:28:35.908428 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 05 11:28:35.910839 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7769489d-4a72-4210-b754-404eec0fc422',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 05 11:28:36.064185 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-07e042a6-3b34-4c9c-a6d8-61bbd370b09e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857682 Apr 05 11:28:36.064795 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 703/1434] 10.222.0.39 () {60 vars in 1146 bytes} [Tue Apr 5 11:28:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 11:28:36.076352 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e6f2e135-c8e0-4739-a7a1-739e60968c17 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:36.076981 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e6f2e135-c8e0-4739-a7a1-739e60968c17 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:36.182545 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e6f2e135-c8e0-4739-a7a1-739e60968c17 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:36.190045 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e6f2e135-c8e0-4739-a7a1-739e60968c17 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1259 microversion: 2.1 time: 0.119202 Apr 05 11:28:36.190695 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 732/1435] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:36 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1259 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:37.207643 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-880c9591-452c-40cd-8827-01fb484941b5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:37.208350 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-880c9591-452c-40cd-8827-01fb484941b5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:37.264305 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-880c9591-452c-40cd-8827-01fb484941b5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:37.271181 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-880c9591-452c-40cd-8827-01fb484941b5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1259 microversion: 2.1 time: 0.067757 Apr 05 11:28:37.272516 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 704/1436] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:37 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:38.287886 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3b5fd673-156f-4bb4-ad94-afc9a37d8237 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:38.288439 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3b5fd673-156f-4bb4-ad94-afc9a37d8237 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:38.296337 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b5fd673-156f-4bb4-ad94-afc9a37d8237 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:38.296337 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b5fd673-156f-4bb4-ad94-afc9a37d8237 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:38.297061 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b5fd673-156f-4bb4-ad94-afc9a37d8237 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:38.297493 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b5fd673-156f-4bb4-ad94-afc9a37d8237 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:38.359337 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3b5fd673-156f-4bb4-ad94-afc9a37d8237 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:38.367011 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3b5fd673-156f-4bb4-ad94-afc9a37d8237 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1311 microversion: 2.1 time: 0.083023 Apr 05 11:28:38.367583 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 733/1437] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:38 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:39.386114 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5c8327f5-d623-4f4d-9662-437013aedb63 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:39.386807 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5c8327f5-d623-4f4d-9662-437013aedb63 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:39.394499 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c8327f5-d623-4f4d-9662-437013aedb63 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:39.395043 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c8327f5-d623-4f4d-9662-437013aedb63 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:39.395830 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c8327f5-d623-4f4d-9662-437013aedb63 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:39.396297 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c8327f5-d623-4f4d-9662-437013aedb63 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:39.457847 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5c8327f5-d623-4f4d-9662-437013aedb63 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:39.465620 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5c8327f5-d623-4f4d-9662-437013aedb63 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1317 microversion: 2.1 time: 0.084184 Apr 05 11:28:39.466413 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 705/1438] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:39 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1317 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:28:40.483322 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5e87b6a1-ffe9-491e-a486-b7b9ac134b21 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:40.484058 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5e87b6a1-ffe9-491e-a486-b7b9ac134b21 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:40.490508 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5e87b6a1-ffe9-491e-a486-b7b9ac134b21 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:40.490921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5e87b6a1-ffe9-491e-a486-b7b9ac134b21 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:40.491694 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5e87b6a1-ffe9-491e-a486-b7b9ac134b21 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:40.492125 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5e87b6a1-ffe9-491e-a486-b7b9ac134b21 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:40.640298 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5e87b6a1-ffe9-491e-a486-b7b9ac134b21 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:40.647933 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5e87b6a1-ffe9-491e-a486-b7b9ac134b21 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.168350 Apr 05 11:28:40.650601 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 734/1439] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:40 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:41.665028 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a5e1fb07-67f5-4f8f-a903-0be22b57f0e0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:41.665585 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a5e1fb07-67f5-4f8f-a903-0be22b57f0e0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:41.671888 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5e1fb07-67f5-4f8f-a903-0be22b57f0e0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:41.672341 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5e1fb07-67f5-4f8f-a903-0be22b57f0e0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:41.673157 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5e1fb07-67f5-4f8f-a903-0be22b57f0e0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:41.673594 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5e1fb07-67f5-4f8f-a903-0be22b57f0e0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:41.824484 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a5e1fb07-67f5-4f8f-a903-0be22b57f0e0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:41.831837 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a5e1fb07-67f5-4f8f-a903-0be22b57f0e0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.170783 Apr 05 11:28:41.832400 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 706/1440] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:41 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:42.848775 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c5498f00-f2bc-485e-8a35-aa05e252e2c6 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:42.849343 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c5498f00-f2bc-485e-8a35-aa05e252e2c6 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:42.856200 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c5498f00-f2bc-485e-8a35-aa05e252e2c6 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:42.856928 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c5498f00-f2bc-485e-8a35-aa05e252e2c6 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:42.858011 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c5498f00-f2bc-485e-8a35-aa05e252e2c6 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:42.858642 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c5498f00-f2bc-485e-8a35-aa05e252e2c6 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:43.006373 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c5498f00-f2bc-485e-8a35-aa05e252e2c6 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:43.014047 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c5498f00-f2bc-485e-8a35-aa05e252e2c6 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.169220 Apr 05 11:28:43.014656 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 735/1441] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:42 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:44.031054 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2de527da-ef5f-429f-b442-cc2dd411011c tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:44.032603 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2de527da-ef5f-429f-b442-cc2dd411011c tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:44.044473 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2de527da-ef5f-429f-b442-cc2dd411011c tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:44.044924 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2de527da-ef5f-429f-b442-cc2dd411011c tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:44.045721 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2de527da-ef5f-429f-b442-cc2dd411011c tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:44.047651 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2de527da-ef5f-429f-b442-cc2dd411011c tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:44.185625 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2de527da-ef5f-429f-b442-cc2dd411011c tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:44.194115 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2de527da-ef5f-429f-b442-cc2dd411011c tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.166887 Apr 05 11:28:44.195014 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 707/1442] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:44 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:45.212657 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c8b48f58-31cb-4d95-9e78-8e81e2f8af81 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:45.213792 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c8b48f58-31cb-4d95-9e78-8e81e2f8af81 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:45.220832 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8b48f58-31cb-4d95-9e78-8e81e2f8af81 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:45.221292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8b48f58-31cb-4d95-9e78-8e81e2f8af81 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:45.222159 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8b48f58-31cb-4d95-9e78-8e81e2f8af81 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:45.222619 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8b48f58-31cb-4d95-9e78-8e81e2f8af81 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:45.381576 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c8b48f58-31cb-4d95-9e78-8e81e2f8af81 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:45.391781 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c8b48f58-31cb-4d95-9e78-8e81e2f8af81 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.182622 Apr 05 11:28:45.393226 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 736/1443] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:45 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:46.409587 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f7deaed0-a3f5-402b-b8f9-c9becb755457 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:46.410721 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f7deaed0-a3f5-402b-b8f9-c9becb755457 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:46.421463 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7deaed0-a3f5-402b-b8f9-c9becb755457 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:46.422335 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7deaed0-a3f5-402b-b8f9-c9becb755457 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:46.423292 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7deaed0-a3f5-402b-b8f9-c9becb755457 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:46.423778 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7deaed0-a3f5-402b-b8f9-c9becb755457 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:46.572291 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f7deaed0-a3f5-402b-b8f9-c9becb755457 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:46.580539 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f7deaed0-a3f5-402b-b8f9-c9becb755457 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.175733 Apr 05 11:28:46.581138 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 708/1444] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:46 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:47.598238 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8cfb881f-70a7-4f63-ac92-bae7b1cea422 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:47.598921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8cfb881f-70a7-4f63-ac92-bae7b1cea422 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:47.605686 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8cfb881f-70a7-4f63-ac92-bae7b1cea422 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:47.606436 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8cfb881f-70a7-4f63-ac92-bae7b1cea422 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:47.608192 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8cfb881f-70a7-4f63-ac92-bae7b1cea422 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:47.608662 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8cfb881f-70a7-4f63-ac92-bae7b1cea422 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:47.750921 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8cfb881f-70a7-4f63-ac92-bae7b1cea422 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:47.758817 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8cfb881f-70a7-4f63-ac92-bae7b1cea422 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.164783 Apr 05 11:28:47.759895 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 737/1445] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:47 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:48.775488 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-503cc676-ef7b-4eac-a356-9157c27f9013 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:48.776128 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-503cc676-ef7b-4eac-a356-9157c27f9013 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:48.782542 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-503cc676-ef7b-4eac-a356-9157c27f9013 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:48.783028 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-503cc676-ef7b-4eac-a356-9157c27f9013 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:48.783809 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-503cc676-ef7b-4eac-a356-9157c27f9013 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:48.784247 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-503cc676-ef7b-4eac-a356-9157c27f9013 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:48.915066 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-503cc676-ef7b-4eac-a356-9157c27f9013 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:48.922786 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-503cc676-ef7b-4eac-a356-9157c27f9013 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.151143 Apr 05 11:28:48.923356 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 709/1446] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:48 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:49.939387 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d2a47cfb-3733-4e63-a34b-8092fddac94f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:49.939994 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d2a47cfb-3733-4e63-a34b-8092fddac94f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:49.946253 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2a47cfb-3733-4e63-a34b-8092fddac94f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:49.946738 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2a47cfb-3733-4e63-a34b-8092fddac94f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:49.947504 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2a47cfb-3733-4e63-a34b-8092fddac94f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:49.947936 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2a47cfb-3733-4e63-a34b-8092fddac94f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:50.078778 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d2a47cfb-3733-4e63-a34b-8092fddac94f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:50.086319 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d2a47cfb-3733-4e63-a34b-8092fddac94f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.150709 Apr 05 11:28:50.087044 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 738/1447] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:49 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:51.104336 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-41d67c8e-454a-4ac9-a1b7-16994a425491 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:51.104953 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-41d67c8e-454a-4ac9-a1b7-16994a425491 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:51.111490 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41d67c8e-454a-4ac9-a1b7-16994a425491 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:51.112832 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41d67c8e-454a-4ac9-a1b7-16994a425491 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:51.112832 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41d67c8e-454a-4ac9-a1b7-16994a425491 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:51.113951 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41d67c8e-454a-4ac9-a1b7-16994a425491 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:51.257626 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-41d67c8e-454a-4ac9-a1b7-16994a425491 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:51.263630 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-41d67c8e-454a-4ac9-a1b7-16994a425491 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.163388 Apr 05 11:28:51.264207 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 710/1448] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:51 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:52.281455 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9216ebf4-8e14-48b2-b9c5-a49b3091adfe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:52.282071 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9216ebf4-8e14-48b2-b9c5-a49b3091adfe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:52.288834 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9216ebf4-8e14-48b2-b9c5-a49b3091adfe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:52.289260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9216ebf4-8e14-48b2-b9c5-a49b3091adfe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:52.290038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9216ebf4-8e14-48b2-b9c5-a49b3091adfe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:52.290474 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9216ebf4-8e14-48b2-b9c5-a49b3091adfe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:52.434543 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9216ebf4-8e14-48b2-b9c5-a49b3091adfe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:52.441963 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9216ebf4-8e14-48b2-b9c5-a49b3091adfe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.164878 Apr 05 11:28:52.442536 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 739/1449] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:52 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:52.827786 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-cfc87e3f-374a-4ded-a09d-5c87f0f7071d req-5a6a5a52-3ab7-44a8-b800-8a2ba3eec93a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3aa2323-57ff-4019-8a14-9917310afeb0", "tag": "e52bac3a-78e8-4b6c-91a1-ce2a24838174"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:28:52.836440 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-cfc87e3f-374a-4ded-a09d-5c87f0f7071d req-5a6a5a52-3ab7-44a8-b800-8a2ba3eec93a service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:52.836688 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-cfc87e3f-374a-4ded-a09d-5c87f0f7071d req-5a6a5a52-3ab7-44a8-b800-8a2ba3eec93a service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:52.854306 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-cfc87e3f-374a-4ded-a09d-5c87f0f7071d req-5a6a5a52-3ab7-44a8-b800-8a2ba3eec93a service nova] Creating event network-changed:e52bac3a-78e8-4b6c-91a1-ce2a24838174 for instance b3aa2323-57ff-4019-8a14-9917310afeb0 on hv-cinder-81899 Apr 05 11:28:52.860406 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-cfc87e3f-374a-4ded-a09d-5c87f0f7071d req-5a6a5a52-3ab7-44a8-b800-8a2ba3eec93a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036882 Apr 05 11:28:52.861013 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 711/1450] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:28:53.459283 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-90b33839-d9d8-4281-863a-a5c86dc913df tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:53.459895 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-90b33839-d9d8-4281-863a-a5c86dc913df tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:53.466881 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90b33839-d9d8-4281-863a-a5c86dc913df tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:53.467336 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90b33839-d9d8-4281-863a-a5c86dc913df tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:53.468111 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90b33839-d9d8-4281-863a-a5c86dc913df tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:53.468551 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90b33839-d9d8-4281-863a-a5c86dc913df tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:53.608909 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-90b33839-d9d8-4281-863a-a5c86dc913df tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:53.616439 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-90b33839-d9d8-4281-863a-a5c86dc913df tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.160987 Apr 05 11:28:53.617029 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 740/1451] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:53 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:54.634440 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5d3526ab-b61a-4ddc-b568-bb25358cd9c5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:54.635154 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5d3526ab-b61a-4ddc-b568-bb25358cd9c5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:54.641843 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d3526ab-b61a-4ddc-b568-bb25358cd9c5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:54.642287 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d3526ab-b61a-4ddc-b568-bb25358cd9c5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:54.643146 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d3526ab-b61a-4ddc-b568-bb25358cd9c5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:54.643587 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d3526ab-b61a-4ddc-b568-bb25358cd9c5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:54.773224 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5d3526ab-b61a-4ddc-b568-bb25358cd9c5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:54.780986 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5d3526ab-b61a-4ddc-b568-bb25358cd9c5 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.151315 Apr 05 11:28:54.781595 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 712/1452] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:54 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:55.798061 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-223c280e-84fc-4e30-ba7f-31b6a1edf5cf tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:55.798736 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-223c280e-84fc-4e30-ba7f-31b6a1edf5cf tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:55.805180 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-223c280e-84fc-4e30-ba7f-31b6a1edf5cf tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:55.805659 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-223c280e-84fc-4e30-ba7f-31b6a1edf5cf tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:55.806437 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-223c280e-84fc-4e30-ba7f-31b6a1edf5cf tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:55.806927 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-223c280e-84fc-4e30-ba7f-31b6a1edf5cf tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:55.941450 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-223c280e-84fc-4e30-ba7f-31b6a1edf5cf tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:55.949240 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-223c280e-84fc-4e30-ba7f-31b6a1edf5cf tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.155630 Apr 05 11:28:55.949826 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 741/1453] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:55 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:56.965429 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-70986104-317c-44a4-8516-df1a554ff4a3 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:56.966663 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-70986104-317c-44a4-8516-df1a554ff4a3 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:56.973642 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-70986104-317c-44a4-8516-df1a554ff4a3 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:56.974137 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-70986104-317c-44a4-8516-df1a554ff4a3 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:56.975334 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-70986104-317c-44a4-8516-df1a554ff4a3 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:56.975826 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-70986104-317c-44a4-8516-df1a554ff4a3 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:57.117791 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-70986104-317c-44a4-8516-df1a554ff4a3 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:57.125646 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-70986104-317c-44a4-8516-df1a554ff4a3 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.163963 Apr 05 11:28:57.126527 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 713/1454] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:56 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:28:58.142507 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-12e79d80-478c-4e0c-9c99-c1992b66182f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:58.143149 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-12e79d80-478c-4e0c-9c99-c1992b66182f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:58.149493 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-12e79d80-478c-4e0c-9c99-c1992b66182f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:58.149950 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-12e79d80-478c-4e0c-9c99-c1992b66182f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:58.150756 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-12e79d80-478c-4e0c-9c99-c1992b66182f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:58.151200 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-12e79d80-478c-4e0c-9c99-c1992b66182f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:58.302896 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-12e79d80-478c-4e0c-9c99-c1992b66182f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:58.310432 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-12e79d80-478c-4e0c-9c99-c1992b66182f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.171750 Apr 05 11:28:58.311059 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 742/1455] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:58 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:59.328025 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-24f8870c-a721-4a1a-8bae-88486b1fbb7f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:28:59.328669 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-24f8870c-a721-4a1a-8bae-88486b1fbb7f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:28:59.335036 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-24f8870c-a721-4a1a-8bae-88486b1fbb7f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:59.335489 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-24f8870c-a721-4a1a-8bae-88486b1fbb7f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:59.336266 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-24f8870c-a721-4a1a-8bae-88486b1fbb7f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:59.336705 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-24f8870c-a721-4a1a-8bae-88486b1fbb7f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:59.466565 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-24f8870c-a721-4a1a-8bae-88486b1fbb7f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:28:59.473927 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-24f8870c-a721-4a1a-8bae-88486b1fbb7f tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.150469 Apr 05 11:28:59.474500 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 714/1456] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:28:59 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:28:59.771512 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-6211e5a3-547d-4eff-975c-fc7e1b9eff88 req-502b9118-8fb9-4777-bac0-5ebc2ebaf003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3aa2323-57ff-4019-8a14-9917310afeb0", "name": "network-vif-plugged", "status": "completed", "tag": "e52bac3a-78e8-4b6c-91a1-ce2a24838174"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:28:59.780082 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-6211e5a3-547d-4eff-975c-fc7e1b9eff88 req-502b9118-8fb9-4777-bac0-5ebc2ebaf003 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:28:59.780535 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-6211e5a3-547d-4eff-975c-fc7e1b9eff88 req-502b9118-8fb9-4777-bac0-5ebc2ebaf003 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:28:59.791884 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-6211e5a3-547d-4eff-975c-fc7e1b9eff88 req-502b9118-8fb9-4777-bac0-5ebc2ebaf003 service nova] Creating event network-vif-plugged:e52bac3a-78e8-4b6c-91a1-ce2a24838174 for instance b3aa2323-57ff-4019-8a14-9917310afeb0 on hv-cinder-81899 Apr 05 11:28:59.797378 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-6211e5a3-547d-4eff-975c-fc7e1b9eff88 req-502b9118-8fb9-4777-bac0-5ebc2ebaf003 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029680 Apr 05 11:28:59.802145 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 743/1457] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:29:00.491326 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b97fa719-a0b9-4445-b664-fa64df5b3dbd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:29:00.491935 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b97fa719-a0b9-4445-b664-fa64df5b3dbd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:29:00.498830 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b97fa719-a0b9-4445-b664-fa64df5b3dbd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:00.499283 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b97fa719-a0b9-4445-b664-fa64df5b3dbd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:00.500052 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b97fa719-a0b9-4445-b664-fa64df5b3dbd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:00.500575 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b97fa719-a0b9-4445-b664-fa64df5b3dbd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:00.646787 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b97fa719-a0b9-4445-b664-fa64df5b3dbd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:29:00.654084 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b97fa719-a0b9-4445-b664-fa64df5b3dbd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.166636 Apr 05 11:29:00.654689 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 715/1458] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:29:00 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:29:01.671551 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b97fb401-0127-4bee-b9f4-e08e98e69201 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:29:01.672163 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b97fb401-0127-4bee-b9f4-e08e98e69201 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:29:01.682288 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b97fb401-0127-4bee-b9f4-e08e98e69201 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:01.682794 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b97fb401-0127-4bee-b9f4-e08e98e69201 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:01.683568 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b97fb401-0127-4bee-b9f4-e08e98e69201 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:01.684606 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b97fb401-0127-4bee-b9f4-e08e98e69201 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:01.827648 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b97fb401-0127-4bee-b9f4-e08e98e69201 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:29:01.835517 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b97fb401-0127-4bee-b9f4-e08e98e69201 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1359 microversion: 2.1 time: 0.169148 Apr 05 11:29:01.836429 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 744/1459] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:29:01 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:29:02.853342 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5659c482-0531-444a-b107-4d3b9ccc9128 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:29:02.853902 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5659c482-0531-444a-b107-4d3b9ccc9128 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:29:02.860843 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5659c482-0531-444a-b107-4d3b9ccc9128 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:02.861292 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5659c482-0531-444a-b107-4d3b9ccc9128 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:02.862061 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5659c482-0531-444a-b107-4d3b9ccc9128 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:02.862493 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5659c482-0531-444a-b107-4d3b9ccc9128 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:02.996275 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5659c482-0531-444a-b107-4d3b9ccc9128 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:29:03.004386 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5659c482-0531-444a-b107-4d3b9ccc9128 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1549 microversion: 2.1 time: 0.155438 Apr 05 11:29:03.004976 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 716/1460] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:29:02 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:29:03.020253 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c4cdfb0b-ba95-4c84-8023-a8582c62ef26 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:29:03.020873 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c4cdfb0b-ba95-4c84-8023-a8582c62ef26 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:29:03.027404 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4cdfb0b-ba95-4c84-8023-a8582c62ef26 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:03.028124 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4cdfb0b-ba95-4c84-8023-a8582c62ef26 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:03.028995 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4cdfb0b-ba95-4c84-8023-a8582c62ef26 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:03.029438 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4cdfb0b-ba95-4c84-8023-a8582c62ef26 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:03.169052 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c4cdfb0b-ba95-4c84-8023-a8582c62ef26 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:29:03.176609 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c4cdfb0b-ba95-4c84-8023-a8582c62ef26 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1549 microversion: 2.1 time: 0.160233 Apr 05 11:29:03.177182 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 745/1461] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:29:03 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:29:03.193242 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c380a394-f2ae-4e6e-98be-23d146dc13ff tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:29:03.197352 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c380a394-f2ae-4e6e-98be-23d146dc13ff tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:29:03.198121 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c380a394-f2ae-4e6e-98be-23d146dc13ff tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Searching by: {'deleted': False, 'project_id': '220a2c61da3646bc944112302aec29c4'} {{(pid=117594) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 05 11:29:03.204663 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c380a394-f2ae-4e6e-98be-23d146dc13ff tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:03.205145 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c380a394-f2ae-4e6e-98be-23d146dc13ff tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:03.205953 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c380a394-f2ae-4e6e-98be-23d146dc13ff tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:03.206443 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c380a394-f2ae-4e6e-98be-23d146dc13ff tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:03.298271 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.multi_cell_list [None req-c380a394-f2ae-4e6e-98be-23d146dc13ff tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 05 11:29:03.389482 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c380a394-f2ae-4e6e-98be-23d146dc13ff tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199900 Apr 05 11:29:03.389990 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 717/1462] 10.222.0.39 () {58 vars in 1124 bytes} [Tue Apr 5 11:29:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:29:03.400491 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7cdcabc0-bdd6-4a4f-b4f7-9cf70e183973 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:29:03.401101 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7cdcabc0-bdd6-4a4f-b4f7-9cf70e183973 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:29:03.407406 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7cdcabc0-bdd6-4a4f-b4f7-9cf70e183973 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:03.407854 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7cdcabc0-bdd6-4a4f-b4f7-9cf70e183973 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:03.408612 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7cdcabc0-bdd6-4a4f-b4f7-9cf70e183973 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:03.409051 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7cdcabc0-bdd6-4a4f-b4f7-9cf70e183973 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:03.537797 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7cdcabc0-bdd6-4a4f-b4f7-9cf70e183973 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:29:03.545667 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7cdcabc0-bdd6-4a4f-b4f7-9cf70e183973 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1549 microversion: 2.1 time: 0.149063 Apr 05 11:29:03.546261 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 746/1463] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:29:03 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:29:05.468947 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-45a7c742-d003-446f-b536-f9527ecb87ab tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ba4b260-b835-4efa-8178-576690cae5be"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:29:05.470015 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-45a7c742-d003-446f-b536-f9527ecb87ab tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:29:05.476500 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45a7c742-d003-446f-b536-f9527ecb87ab tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:05.476948 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45a7c742-d003-446f-b536-f9527ecb87ab tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:05.477719 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45a7c742-d003-446f-b536-f9527ecb87ab tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:05.478154 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45a7c742-d003-446f-b536-f9527ecb87ab tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:06.275535 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-45a7c742-d003-446f-b536-f9527ecb87ab tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "POST /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.810804 Apr 05 11:29:06.276153 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 718/1464] 10.222.0.39 () {60 vars in 1322 bytes} [Tue Apr 5 11:29:05 2022] POST /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/os-volume_attachments => generated 194 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:29:19.066125 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0a78f357-811e-4d10-9b78-0297400a29a4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:29:19.066865 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0a78f357-811e-4d10-9b78-0297400a29a4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:29:19.072942 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a78f357-811e-4d10-9b78-0297400a29a4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:19.073388 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a78f357-811e-4d10-9b78-0297400a29a4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:19.074839 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a78f357-811e-4d10-9b78-0297400a29a4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:19.075271 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a78f357-811e-4d10-9b78-0297400a29a4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:19.206126 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0a78f357-811e-4d10-9b78-0297400a29a4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:29:19.214055 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0a78f357-811e-4d10-9b78-0297400a29a4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1595 microversion: 2.1 time: 0.151709 Apr 05 11:29:19.214624 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 747/1465] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:29:19 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1595 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:29:21.547413 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-ee4cb433-a1af-4d0d-ab07-3c9f0323922d req-38c86d9d-b9a4-4a1f-bb34-bd3d90df220e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3aa2323-57ff-4019-8a14-9917310afeb0", "tag": "e52bac3a-78e8-4b6c-91a1-ce2a24838174"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:29:21.557714 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-ee4cb433-a1af-4d0d-ab07-3c9f0323922d req-38c86d9d-b9a4-4a1f-bb34-bd3d90df220e service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:21.558920 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-ee4cb433-a1af-4d0d-ab07-3c9f0323922d req-38c86d9d-b9a4-4a1f-bb34-bd3d90df220e service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:21.569921 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-ee4cb433-a1af-4d0d-ab07-3c9f0323922d req-38c86d9d-b9a4-4a1f-bb34-bd3d90df220e service nova] Creating event network-changed:e52bac3a-78e8-4b6c-91a1-ce2a24838174 for instance b3aa2323-57ff-4019-8a14-9917310afeb0 on hv-cinder-81899 Apr 05 11:29:21.577101 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-ee4cb433-a1af-4d0d-ab07-3c9f0323922d req-38c86d9d-b9a4-4a1f-bb34-bd3d90df220e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034166 Apr 05 11:29:21.577888 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 719/1466] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:29:24.531893 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-466a1651-e24c-4bd6-addf-2e417e916b1d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2099859167"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:29:24.532476 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-466a1651-e24c-4bd6-addf-2e417e916b1d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:29:24.538897 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-466a1651-e24c-4bd6-addf-2e417e916b1d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:24.539369 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-466a1651-e24c-4bd6-addf-2e417e916b1d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:24.540124 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-466a1651-e24c-4bd6-addf-2e417e916b1d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:24.540600 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-466a1651-e24c-4bd6-addf-2e417e916b1d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:24.672148 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.network.security_group_api [None req-466a1651-e24c-4bd6-addf-2e417e916b1d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Adding security group 678acc80-0387-42a9-9011-c31358a66fc4 to port e52bac3a-78e8-4b6c-91a1-ce2a24838174 Apr 05 11:29:25.093890 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-466a1651-e24c-4bd6-addf-2e417e916b1d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "POST /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/action" status: 202 len: 0 microversion: 2.1 time: 0.562659 Apr 05 11:29:25.095890 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 748/1467] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:29:24 2022] POST /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:29:25.107690 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-237e13ba-2740-4761-ac1d-5e1dab4d8b3a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:29:25.108595 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-237e13ba-2740-4761-ac1d-5e1dab4d8b3a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:29:25.117260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-237e13ba-2740-4761-ac1d-5e1dab4d8b3a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:25.118459 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-237e13ba-2740-4761-ac1d-5e1dab4d8b3a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:25.119669 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-237e13ba-2740-4761-ac1d-5e1dab4d8b3a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:25.120363 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-237e13ba-2740-4761-ac1d-5e1dab4d8b3a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:25.182350 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-0543a4cd-33ce-4059-9247-0f8d72880c42 req-5f3ca673-8ac4-4784-80e6-eaf370345587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3aa2323-57ff-4019-8a14-9917310afeb0", "tag": "e52bac3a-78e8-4b6c-91a1-ce2a24838174"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:29:25.203210 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-0543a4cd-33ce-4059-9247-0f8d72880c42 req-5f3ca673-8ac4-4784-80e6-eaf370345587 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:25.203763 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-0543a4cd-33ce-4059-9247-0f8d72880c42 req-5f3ca673-8ac4-4784-80e6-eaf370345587 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:25.216252 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-0543a4cd-33ce-4059-9247-0f8d72880c42 req-5f3ca673-8ac4-4784-80e6-eaf370345587 service nova] Creating event network-changed:e52bac3a-78e8-4b6c-91a1-ce2a24838174 for instance b3aa2323-57ff-4019-8a14-9917310afeb0 on hv-cinder-81899 Apr 05 11:29:25.221932 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-0543a4cd-33ce-4059-9247-0f8d72880c42 req-5f3ca673-8ac4-4784-80e6-eaf370345587 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127666 Apr 05 11:29:25.222701 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 720/1468] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:29:25.356101 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-237e13ba-2740-4761-ac1d-5e1dab4d8b3a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:29:25.364818 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-237e13ba-2740-4761-ac1d-5e1dab4d8b3a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1761 microversion: 2.1 time: 0.264408 Apr 05 11:29:25.365733 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 749/1469] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:29:25 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1761 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:29:58.387520 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0e82b7db-af90-47e7-a86d-67dab126a47e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:29:58.389484 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0e82b7db-af90-47e7-a86d-67dab126a47e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:29:58.389605 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-55366e71-5161-474b-81c7-db8ee655a78e req-6ca663f6-594c-40d7-b341-2dd69d3cc1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4de53323-ab77-461a-aeea-8cdf6fe059f6", "tag": "91a37f0f-bb87-45a8-b411-406bb0d3d30f"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:29:58.394742 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0e82b7db-af90-47e7-a86d-67dab126a47e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:58.395181 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0e82b7db-af90-47e7-a86d-67dab126a47e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:58.395958 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0e82b7db-af90-47e7-a86d-67dab126a47e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:58.396804 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0e82b7db-af90-47e7-a86d-67dab126a47e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:58.396938 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-55366e71-5161-474b-81c7-db8ee655a78e req-6ca663f6-594c-40d7-b341-2dd69d3cc1d5 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:58.397129 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-55366e71-5161-474b-81c7-db8ee655a78e req-6ca663f6-594c-40d7-b341-2dd69d3cc1d5 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:58.411071 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-55366e71-5161-474b-81c7-db8ee655a78e req-6ca663f6-594c-40d7-b341-2dd69d3cc1d5 service nova] Creating event network-changed:91a37f0f-bb87-45a8-b411-406bb0d3d30f for instance 4de53323-ab77-461a-aeea-8cdf6fe059f6 on hv-cinder-81899 Apr 05 11:29:58.418006 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-55366e71-5161-474b-81c7-db8ee655a78e req-6ca663f6-594c-40d7-b341-2dd69d3cc1d5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033361 Apr 05 11:29:58.419014 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 750/1470] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:29:58.424615 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0e82b7db-af90-47e7-a86d-67dab126a47e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:29:58.742656 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0e82b7db-af90-47e7-a86d-67dab126a47e tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 204 len: 0 microversion: 2.1 time: 0.355226 Apr 05 11:29:58.742656 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 721/1471] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:29:58 2022] DELETE /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:29:58.747818 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-41598f5c-b10c-4a1f-92fd-1964231fa37f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:29:58.748634 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-41598f5c-b10c-4a1f-92fd-1964231fa37f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:29:58.755496 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41598f5c-b10c-4a1f-92fd-1964231fa37f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:58.755945 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41598f5c-b10c-4a1f-92fd-1964231fa37f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:58.756754 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41598f5c-b10c-4a1f-92fd-1964231fa37f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:58.757230 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41598f5c-b10c-4a1f-92fd-1964231fa37f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:58.921114 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-41598f5c-b10c-4a1f-92fd-1964231fa37f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:29:58.932354 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-41598f5c-b10c-4a1f-92fd-1964231fa37f tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1576 microversion: 2.1 time: 0.189058 Apr 05 11:29:58.933033 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 751/1472] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:29:58 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:29:59.952313 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1a2499ce-b619-45a4-9537-0b21bbce8e97 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:29:59.954877 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1a2499ce-b619-45a4-9537-0b21bbce8e97 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:29:59.959759 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a2499ce-b619-45a4-9537-0b21bbce8e97 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:59.960202 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a2499ce-b619-45a4-9537-0b21bbce8e97 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:29:59.960966 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a2499ce-b619-45a4-9537-0b21bbce8e97 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:29:59.961392 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a2499ce-b619-45a4-9537-0b21bbce8e97 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:00.104867 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1a2499ce-b619-45a4-9537-0b21bbce8e97 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:00.112746 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1a2499ce-b619-45a4-9537-0b21bbce8e97 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1576 microversion: 2.1 time: 0.165014 Apr 05 11:30:00.113317 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 722/1473] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:29:59 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:01.129854 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ce540e5d-537e-4338-900e-602651d1cbf3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:01.130797 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ce540e5d-537e-4338-900e-602651d1cbf3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:01.137046 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ce540e5d-537e-4338-900e-602651d1cbf3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:01.156269 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ce540e5d-537e-4338-900e-602651d1cbf3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:01.156269 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ce540e5d-537e-4338-900e-602651d1cbf3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:01.156269 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ce540e5d-537e-4338-900e-602651d1cbf3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:01.205425 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-7bea27ee-cfbb-4f05-95b7-f88ea1ae8bb0 req-fc607159-ff83-4cd9-83eb-26bae5fbfb3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de53323-ab77-461a-aeea-8cdf6fe059f6", "name": "network-vif-deleted", "tag": "91a37f0f-bb87-45a8-b411-406bb0d3d30f"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:30:01.209005 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ce540e5d-537e-4338-900e-602651d1cbf3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:01.214551 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-7bea27ee-cfbb-4f05-95b7-f88ea1ae8bb0 req-fc607159-ff83-4cd9-83eb-26bae5fbfb3a service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:01.215011 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-7bea27ee-cfbb-4f05-95b7-f88ea1ae8bb0 req-fc607159-ff83-4cd9-83eb-26bae5fbfb3a service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:01.217563 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ce540e5d-537e-4338-900e-602651d1cbf3 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1390 microversion: 2.1 time: 0.091656 Apr 05 11:30:01.218372 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 752/1474] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:01 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:01.226531 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-7bea27ee-cfbb-4f05-95b7-f88ea1ae8bb0 req-fc607159-ff83-4cd9-83eb-26bae5fbfb3a service nova] Creating event network-vif-deleted:91a37f0f-bb87-45a8-b411-406bb0d3d30f for instance 4de53323-ab77-461a-aeea-8cdf6fe059f6 on hv-cinder-81899 Apr 05 11:30:01.232123 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-7bea27ee-cfbb-4f05-95b7-f88ea1ae8bb0 req-fc607159-ff83-4cd9-83eb-26bae5fbfb3a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030279 Apr 05 11:30:01.232714 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 723/1475] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:30:02.235095 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-98df7879-2534-4ee2-923e-52efd3075441 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:02.236441 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-98df7879-2534-4ee2-923e-52efd3075441 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:02.242094 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-98df7879-2534-4ee2-923e-52efd3075441 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:02.242539 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-98df7879-2534-4ee2-923e-52efd3075441 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:02.243330 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-98df7879-2534-4ee2-923e-52efd3075441 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:02.243758 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-98df7879-2534-4ee2-923e-52efd3075441 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:02.274624 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-98df7879-2534-4ee2-923e-52efd3075441 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:02.274624 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-98df7879-2534-4ee2-923e-52efd3075441 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:02.275002 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-98df7879-2534-4ee2-923e-52efd3075441 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lazy-loading 'fault' on Instance uuid 4de53323-ab77-461a-aeea-8cdf6fe059f6 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:30:02.320774 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-98df7879-2534-4ee2-923e-52efd3075441 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:02.328679 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-98df7879-2534-4ee2-923e-52efd3075441 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 200 len: 1229 microversion: 2.1 time: 0.097586 Apr 05 11:30:02.333889 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 753/1476] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:02 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:03.347542 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6d384a57-5b37-468a-ae4f-4ec098d5eb85 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:03.348493 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6d384a57-5b37-468a-ae4f-4ec098d5eb85 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 4de53323-ab77-461a-aeea-8cdf6fe059f6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:03.355301 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d384a57-5b37-468a-ae4f-4ec098d5eb85 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:03.355753 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d384a57-5b37-468a-ae4f-4ec098d5eb85 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:03.356521 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d384a57-5b37-468a-ae4f-4ec098d5eb85 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:03.356966 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d384a57-5b37-468a-ae4f-4ec098d5eb85 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:03.369694 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-6d384a57-5b37-468a-ae4f-4ec098d5eb85 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] HTTP exception thrown: Instance 4de53323-ab77-461a-aeea-8cdf6fe059f6 could not be found. Apr 05 11:30:03.370287 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6d384a57-5b37-468a-ae4f-4ec098d5eb85 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Returning 404 to user: Instance 4de53323-ab77-461a-aeea-8cdf6fe059f6 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:30:03.371149 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6d384a57-5b37-468a-ae4f-4ec098d5eb85 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6" status: 404 len: 111 microversion: 2.1 time: 0.028370 Apr 05 11:30:03.371689 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 724/1477] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:03 2022] GET /compute/v2.1/servers/4de53323-ab77-461a-aeea-8cdf6fe059f6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:30:07.042741 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:30:07.044147 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: Tue Apr 5 11:30:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:30:07.120796 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-c059d11a-7a7f-41bd-a127-4b7ac82ac7f0 req-d8782ec9-e077-44b7-8b6f-52820a15462d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "341c39fa-78c6-4a88-88a4-24c130ec377d", "tag": "42ed496a-3344-4417-81b6-eec909ddf26d"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:30:07.121391 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d3df851b-7bdd-4be2-8fe2-e0db33655872 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:07.122075 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d3df851b-7bdd-4be2-8fe2-e0db33655872 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:07.129541 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-c059d11a-7a7f-41bd-a127-4b7ac82ac7f0 req-d8782ec9-e077-44b7-8b6f-52820a15462d service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:07.129978 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-c059d11a-7a7f-41bd-a127-4b7ac82ac7f0 req-d8782ec9-e077-44b7-8b6f-52820a15462d service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:07.133350 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3df851b-7bdd-4be2-8fe2-e0db33655872 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:07.134158 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3df851b-7bdd-4be2-8fe2-e0db33655872 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:07.135622 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3df851b-7bdd-4be2-8fe2-e0db33655872 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:07.136403 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d3df851b-7bdd-4be2-8fe2-e0db33655872 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:07.141718 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-c059d11a-7a7f-41bd-a127-4b7ac82ac7f0 req-d8782ec9-e077-44b7-8b6f-52820a15462d service nova] Creating event network-changed:42ed496a-3344-4417-81b6-eec909ddf26d for instance 341c39fa-78c6-4a88-88a4-24c130ec377d on hv-cinder-81899 Apr 05 11:30:07.149319 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-c059d11a-7a7f-41bd-a127-4b7ac82ac7f0 req-d8782ec9-e077-44b7-8b6f-52820a15462d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031569 Apr 05 11:30:07.151274 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 725/1478] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:30:07.172281 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d3df851b-7bdd-4be2-8fe2-e0db33655872 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:30:07.503397 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d3df851b-7bdd-4be2-8fe2-e0db33655872 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "DELETE /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 204 len: 0 microversion: 2.1 time: 0.390309 Apr 05 11:30:07.504246 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 754/1479] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:30:07 2022] DELETE /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:30:07.513892 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0ed45a3c-d81b-4a1c-87f7-24ae58a28c49 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:07.514759 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0ed45a3c-d81b-4a1c-87f7-24ae58a28c49 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:07.521512 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ed45a3c-d81b-4a1c-87f7-24ae58a28c49 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:07.522079 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ed45a3c-d81b-4a1c-87f7-24ae58a28c49 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:07.522980 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ed45a3c-d81b-4a1c-87f7-24ae58a28c49 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:07.523487 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ed45a3c-d81b-4a1c-87f7-24ae58a28c49 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:07.764595 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0ed45a3c-d81b-4a1c-87f7-24ae58a28c49 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:07.775272 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0ed45a3c-d81b-4a1c-87f7-24ae58a28c49 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1574 microversion: 2.1 time: 0.266455 Apr 05 11:30:07.775949 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 726/1480] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:07 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1574 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:08.794554 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a4a5821b-886c-4639-81e1-5c6e62ba16d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:08.795287 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a4a5821b-886c-4639-81e1-5c6e62ba16d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:08.801825 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a4a5821b-886c-4639-81e1-5c6e62ba16d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:08.802277 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a4a5821b-886c-4639-81e1-5c6e62ba16d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:08.803121 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a4a5821b-886c-4639-81e1-5c6e62ba16d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:08.803703 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a4a5821b-886c-4639-81e1-5c6e62ba16d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:08.866714 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a4a5821b-886c-4639-81e1-5c6e62ba16d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:08.874302 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a4a5821b-886c-4639-81e1-5c6e62ba16d0 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1389 microversion: 2.1 time: 0.084897 Apr 05 11:30:08.874914 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 755/1481] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:08 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:30:09.165002 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-1fe2cce4-9913-4959-aa36-8e1c2ffda107 req-8f734367-45c9-41f4-8b85-92cb67369fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341c39fa-78c6-4a88-88a4-24c130ec377d", "name": "network-vif-deleted", "tag": "42ed496a-3344-4417-81b6-eec909ddf26d"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:30:09.174187 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-1fe2cce4-9913-4959-aa36-8e1c2ffda107 req-8f734367-45c9-41f4-8b85-92cb67369fd7 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:09.174632 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-1fe2cce4-9913-4959-aa36-8e1c2ffda107 req-8f734367-45c9-41f4-8b85-92cb67369fd7 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:09.186379 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-1fe2cce4-9913-4959-aa36-8e1c2ffda107 req-8f734367-45c9-41f4-8b85-92cb67369fd7 service nova] Creating event network-vif-deleted:42ed496a-3344-4417-81b6-eec909ddf26d for instance 341c39fa-78c6-4a88-88a4-24c130ec377d on hv-cinder-81899 Apr 05 11:30:09.191208 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-1fe2cce4-9913-4959-aa36-8e1c2ffda107 req-8f734367-45c9-41f4-8b85-92cb67369fd7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029857 Apr 05 11:30:09.195531 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 727/1482] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:30:09.891769 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ec0f1d69-6ae1-4e06-ba65-c1d5dc1756f6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:09.892540 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ec0f1d69-6ae1-4e06-ba65-c1d5dc1756f6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:09.898304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec0f1d69-6ae1-4e06-ba65-c1d5dc1756f6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:09.898806 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec0f1d69-6ae1-4e06-ba65-c1d5dc1756f6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:09.899572 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec0f1d69-6ae1-4e06-ba65-c1d5dc1756f6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:09.900011 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec0f1d69-6ae1-4e06-ba65-c1d5dc1756f6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:09.933335 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec0f1d69-6ae1-4e06-ba65-c1d5dc1756f6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:09.933851 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec0f1d69-6ae1-4e06-ba65-c1d5dc1756f6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:09.934307 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-ec0f1d69-6ae1-4e06-ba65-c1d5dc1756f6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lazy-loading 'fault' on Instance uuid 341c39fa-78c6-4a88-88a4-24c130ec377d {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:30:09.976339 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ec0f1d69-6ae1-4e06-ba65-c1d5dc1756f6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068fa3223349449db508a275fa38ffdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1827315aac4bfdacff856a13f90eb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:09.984698 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ec0f1d69-6ae1-4e06-ba65-c1d5dc1756f6 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 200 len: 1228 microversion: 2.1 time: 0.097335 Apr 05 11:30:09.985510 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 756/1483] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:09 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 1228 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:11.002325 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7d01002a-24c2-4753-80c2-c48a5d924650 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:11.003052 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7d01002a-24c2-4753-80c2-c48a5d924650 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 341c39fa-78c6-4a88-88a4-24c130ec377d] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:11.009190 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d01002a-24c2-4753-80c2-c48a5d924650 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:11.009668 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d01002a-24c2-4753-80c2-c48a5d924650 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:11.010435 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d01002a-24c2-4753-80c2-c48a5d924650 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:11.010905 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d01002a-24c2-4753-80c2-c48a5d924650 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:11.023985 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-7d01002a-24c2-4753-80c2-c48a5d924650 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] HTTP exception thrown: Instance 341c39fa-78c6-4a88-88a4-24c130ec377d could not be found. Apr 05 11:30:11.024581 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7d01002a-24c2-4753-80c2-c48a5d924650 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Returning 404 to user: Instance 341c39fa-78c6-4a88-88a4-24c130ec377d could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:30:11.025963 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7d01002a-24c2-4753-80c2-c48a5d924650 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d" status: 404 len: 111 microversion: 2.1 time: 0.028331 Apr 05 11:30:11.026513 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 728/1484] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:10 2022] GET /compute/v2.1/servers/341c39fa-78c6-4a88-88a4-24c130ec377d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:30:11.469989 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d92e6b8c-eb3b-453e-b82a-a1e35723ec47 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:30:11.476111 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d92e6b8c-eb3b-453e-b82a-a1e35723ec47 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:11.481762 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d92e6b8c-eb3b-453e-b82a-a1e35723ec47 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:11.482208 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d92e6b8c-eb3b-453e-b82a-a1e35723ec47 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:11.483001 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d92e6b8c-eb3b-453e-b82a-a1e35723ec47 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:11.483429 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d92e6b8c-eb3b-453e-b82a-a1e35723ec47 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:11.542786 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-de8edaa5-fab7-4fed-8714-50e9309c1d17 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:11.543323 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-de8edaa5-fab7-4fed-8714-50e9309c1d17 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:11.549299 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-de8edaa5-fab7-4fed-8714-50e9309c1d17 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:11.555282 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-de8edaa5-fab7-4fed-8714-50e9309c1d17 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:11.555282 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-de8edaa5-fab7-4fed-8714-50e9309c1d17 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:11.555282 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-de8edaa5-fab7-4fed-8714-50e9309c1d17 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:11.563864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-de8edaa5-fab7-4fed-8714-50e9309c1d17 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] HTTP exception thrown: Instance 1af2a30d-f115-44a9-9a90-d1699560bd75 could not be found. Apr 05 11:30:11.564441 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-de8edaa5-fab7-4fed-8714-50e9309c1d17 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Returning 404 to user: Instance 1af2a30d-f115-44a9-9a90-d1699560bd75 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:30:11.565245 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-de8edaa5-fab7-4fed-8714-50e9309c1d17 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 404 len: 111 microversion: 2.1 time: 0.027142 Apr 05 11:30:11.565768 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 729/1485] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:30:11 2022] DELETE /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:30:11.573712 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-07e5efa6-b84a-4f26-ab97-fccd49634979 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:11.574328 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-07e5efa6-b84a-4f26-ab97-fccd49634979 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] [instance: 1af2a30d-f115-44a9-9a90-d1699560bd75] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:11.580238 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07e5efa6-b84a-4f26-ab97-fccd49634979 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:11.586169 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07e5efa6-b84a-4f26-ab97-fccd49634979 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:11.586169 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07e5efa6-b84a-4f26-ab97-fccd49634979 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:11.586169 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07e5efa6-b84a-4f26-ab97-fccd49634979 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:11.595415 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-07e5efa6-b84a-4f26-ab97-fccd49634979 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] HTTP exception thrown: Instance 1af2a30d-f115-44a9-9a90-d1699560bd75 could not be found. Apr 05 11:30:11.596059 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-07e5efa6-b84a-4f26-ab97-fccd49634979 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Returning 404 to user: Instance 1af2a30d-f115-44a9-9a90-d1699560bd75 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:30:11.596883 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-07e5efa6-b84a-4f26-ab97-fccd49634979 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75" status: 404 len: 111 microversion: 2.1 time: 0.026814 Apr 05 11:30:11.597671 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 730/1486] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:11 2022] GET /compute/v2.1/servers/1af2a30d-f115-44a9-9a90-d1699560bd75 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 11:30:11.707185 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d92e6b8c-eb3b-453e-b82a-a1e35723ec47 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "POST /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/action" status: 202 len: 0 microversion: 2.1 time: 0.240801 Apr 05 11:30:11.707929 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 757/1487] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:30:11 2022] POST /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 11:30:11.716801 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-79ee87bf-82ce-4371-a7a6-722455272513 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:11.717466 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-79ee87bf-82ce-4371-a7a6-722455272513 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:11.723777 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79ee87bf-82ce-4371-a7a6-722455272513 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:11.724240 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79ee87bf-82ce-4371-a7a6-722455272513 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:11.725048 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79ee87bf-82ce-4371-a7a6-722455272513 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:11.725488 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79ee87bf-82ce-4371-a7a6-722455272513 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:11.879612 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-79ee87bf-82ce-4371-a7a6-722455272513 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:11.891587 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-79ee87bf-82ce-4371-a7a6-722455272513 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1753 microversion: 2.1 time: 0.179136 Apr 05 11:30:11.892400 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 731/1488] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:11 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:12.911341 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-953016a0-dec4-4c5c-9fe3-7e54039e8eaa tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:12.912031 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-953016a0-dec4-4c5c-9fe3-7e54039e8eaa tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:12.921445 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-953016a0-dec4-4c5c-9fe3-7e54039e8eaa tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:12.921898 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-953016a0-dec4-4c5c-9fe3-7e54039e8eaa tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:12.922712 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-953016a0-dec4-4c5c-9fe3-7e54039e8eaa tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:12.923149 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-953016a0-dec4-4c5c-9fe3-7e54039e8eaa tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:13.102078 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-953016a0-dec4-4c5c-9fe3-7e54039e8eaa tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:13.110356 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-953016a0-dec4-4c5c-9fe3-7e54039e8eaa tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1758 microversion: 2.1 time: 0.203604 Apr 05 11:30:13.110966 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 758/1489] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:12 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:13.140223 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c3546c11-082b-4e40-bf19-818b8d715a94 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] Calling method '.version_select at 0x7fec06f37ee0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:13.218226 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c3546c11-082b-4e40-bf19-818b8d715a94 tempest-TestVolumeBootPattern-581343173 tempest-TestVolumeBootPattern-581343173-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-72033448" status: 202 len: 0 microversion: 2.1 time: 0.081879 Apr 05 11:30:13.218908 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 732/1490] 10.222.0.39 () {58 vars in 1256 bytes} [Tue Apr 5 11:30:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-72033448 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:30:14.129180 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2443c5e2-714f-4bfa-a30c-e990437d2318 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:14.129793 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2443c5e2-714f-4bfa-a30c-e990437d2318 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:14.136637 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2443c5e2-714f-4bfa-a30c-e990437d2318 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:14.137092 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2443c5e2-714f-4bfa-a30c-e990437d2318 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:14.137861 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2443c5e2-714f-4bfa-a30c-e990437d2318 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:14.138292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2443c5e2-714f-4bfa-a30c-e990437d2318 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:14.302445 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2443c5e2-714f-4bfa-a30c-e990437d2318 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:14.317875 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2443c5e2-714f-4bfa-a30c-e990437d2318 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1758 microversion: 2.1 time: 0.192273 Apr 05 11:30:14.322819 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 759/1491] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:14 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:15.349830 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0c2bdbfd-682f-49c4-a651-fa54602ad6dc tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:15.351092 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0c2bdbfd-682f-49c4-a651-fa54602ad6dc tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:15.360306 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0c2bdbfd-682f-49c4-a651-fa54602ad6dc tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:15.361035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0c2bdbfd-682f-49c4-a651-fa54602ad6dc tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:15.362029 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0c2bdbfd-682f-49c4-a651-fa54602ad6dc tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:15.362671 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0c2bdbfd-682f-49c4-a651-fa54602ad6dc tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:15.791558 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0c2bdbfd-682f-49c4-a651-fa54602ad6dc tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:15.800606 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0c2bdbfd-682f-49c4-a651-fa54602ad6dc tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1758 microversion: 2.1 time: 0.455009 Apr 05 11:30:15.801184 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 733/1492] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:15 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1758 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:16.818722 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-86d218bf-750a-4810-a08a-e69870659bbe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:16.819480 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-86d218bf-750a-4810-a08a-e69870659bbe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:16.825519 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86d218bf-750a-4810-a08a-e69870659bbe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:16.826304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86d218bf-750a-4810-a08a-e69870659bbe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:16.828660 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86d218bf-750a-4810-a08a-e69870659bbe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:16.829437 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-86d218bf-750a-4810-a08a-e69870659bbe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:17.002096 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-86d218bf-750a-4810-a08a-e69870659bbe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:17.010198 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-86d218bf-750a-4810-a08a-e69870659bbe tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1758 microversion: 2.1 time: 0.195499 Apr 05 11:30:17.010799 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 760/1493] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:16 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1758 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:18.027376 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-66b251c4-1abd-4e2e-bf76-f89abd13dabd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:18.028018 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-66b251c4-1abd-4e2e-bf76-f89abd13dabd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:18.034203 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-66b251c4-1abd-4e2e-bf76-f89abd13dabd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:18.034681 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-66b251c4-1abd-4e2e-bf76-f89abd13dabd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:18.035467 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-66b251c4-1abd-4e2e-bf76-f89abd13dabd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:18.035895 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-66b251c4-1abd-4e2e-bf76-f89abd13dabd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:18.189143 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-66b251c4-1abd-4e2e-bf76-f89abd13dabd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:18.197031 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-66b251c4-1abd-4e2e-bf76-f89abd13dabd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1758 microversion: 2.1 time: 0.173627 Apr 05 11:30:18.197814 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 734/1494] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:18 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:19.214419 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f5c874cc-1977-4267-b63e-ded57d6b14c4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:19.215229 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f5c874cc-1977-4267-b63e-ded57d6b14c4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:19.222642 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f5c874cc-1977-4267-b63e-ded57d6b14c4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:19.223478 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f5c874cc-1977-4267-b63e-ded57d6b14c4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:19.224350 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f5c874cc-1977-4267-b63e-ded57d6b14c4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:19.224987 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f5c874cc-1977-4267-b63e-ded57d6b14c4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:19.477452 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f5c874cc-1977-4267-b63e-ded57d6b14c4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:19.485987 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f5c874cc-1977-4267-b63e-ded57d6b14c4 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1758 microversion: 2.1 time: 0.275946 Apr 05 11:30:19.486567 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 761/1495] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:19 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1758 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 11:30:20.504321 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dc740771-39e0-42b4-ab53-a480d0e8d81e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:20.504992 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dc740771-39e0-42b4-ab53-a480d0e8d81e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:20.512460 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dc740771-39e0-42b4-ab53-a480d0e8d81e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:20.512912 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dc740771-39e0-42b4-ab53-a480d0e8d81e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:20.513682 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dc740771-39e0-42b4-ab53-a480d0e8d81e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:20.514111 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dc740771-39e0-42b4-ab53-a480d0e8d81e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:20.661802 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dc740771-39e0-42b4-ab53-a480d0e8d81e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:20.669747 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dc740771-39e0-42b4-ab53-a480d0e8d81e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1758 microversion: 2.1 time: 0.169447 Apr 05 11:30:20.670251 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 735/1496] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:20 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:21.686562 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-29563076-ff70-4aac-ba4e-d745dcde3221 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:21.687193 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-29563076-ff70-4aac-ba4e-d745dcde3221 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:21.693610 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29563076-ff70-4aac-ba4e-d745dcde3221 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:21.694067 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29563076-ff70-4aac-ba4e-d745dcde3221 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:21.695043 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29563076-ff70-4aac-ba4e-d745dcde3221 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:21.695485 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-29563076-ff70-4aac-ba4e-d745dcde3221 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:21.877077 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-29563076-ff70-4aac-ba4e-d745dcde3221 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:21.888031 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-29563076-ff70-4aac-ba4e-d745dcde3221 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1758 microversion: 2.1 time: 0.205248 Apr 05 11:30:21.890110 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 762/1497] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:21 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1758 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:22.905509 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4ee10e7e-5fe7-47a4-bc8b-9287bcd54b7a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:22.906265 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4ee10e7e-5fe7-47a4-bc8b-9287bcd54b7a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:22.913247 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4ee10e7e-5fe7-47a4-bc8b-9287bcd54b7a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:22.913783 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4ee10e7e-5fe7-47a4-bc8b-9287bcd54b7a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:22.914568 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4ee10e7e-5fe7-47a4-bc8b-9287bcd54b7a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:22.915041 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4ee10e7e-5fe7-47a4-bc8b-9287bcd54b7a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:23.060153 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4ee10e7e-5fe7-47a4-bc8b-9287bcd54b7a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:23.072366 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4ee10e7e-5fe7-47a4-bc8b-9287bcd54b7a tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1758 microversion: 2.1 time: 0.169482 Apr 05 11:30:23.073599 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 736/1498] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:22 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:30:24.096159 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-47687bab-a98e-49fa-a2e5-cdfe86a88909 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:30:24.096763 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-47687bab-a98e-49fa-a2e5-cdfe86a88909 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:30:24.103854 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47687bab-a98e-49fa-a2e5-cdfe86a88909 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:24.104296 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47687bab-a98e-49fa-a2e5-cdfe86a88909 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:24.105049 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47687bab-a98e-49fa-a2e5-cdfe86a88909 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:30:24.105482 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47687bab-a98e-49fa-a2e5-cdfe86a88909 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:30:24.250260 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-47687bab-a98e-49fa-a2e5-cdfe86a88909 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:30:24.258092 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-47687bab-a98e-49fa-a2e5-cdfe86a88909 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1761 microversion: 2.1 time: 0.165792 Apr 05 11:30:24.258689 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 763/1499] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:30:24 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1761 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:31:27.572097 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e29e0b3b-9bb8-4e76-a5c4-6a83b88b77f0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2099859167"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:31:27.572679 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e29e0b3b-9bb8-4e76-a5c4-6a83b88b77f0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:31:27.578660 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e29e0b3b-9bb8-4e76-a5c4-6a83b88b77f0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:27.579118 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e29e0b3b-9bb8-4e76-a5c4-6a83b88b77f0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:27.579874 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e29e0b3b-9bb8-4e76-a5c4-6a83b88b77f0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:27.580304 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e29e0b3b-9bb8-4e76-a5c4-6a83b88b77f0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:27.710319 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.network.security_group_api [None req-e29e0b3b-9bb8-4e76-a5c4-6a83b88b77f0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Removing security group 678acc80-0387-42a9-9011-c31358a66fc4 from port e52bac3a-78e8-4b6c-91a1-ce2a24838174 Apr 05 11:31:28.117855 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e29e0b3b-9bb8-4e76-a5c4-6a83b88b77f0 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "POST /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/action" status: 202 len: 0 microversion: 2.1 time: 0.550474 Apr 05 11:31:28.121383 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 737/1500] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Apr 5 11:31:27 2022] POST /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:31:28.390062 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-bf721779-74ee-4a91-b1b7-21e740a095d1 req-e97b9fa6-0f8d-4c0d-acf7-e21e165f184f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3aa2323-57ff-4019-8a14-9917310afeb0", "tag": "e52bac3a-78e8-4b6c-91a1-ce2a24838174"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:31:28.398947 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-bf721779-74ee-4a91-b1b7-21e740a095d1 req-e97b9fa6-0f8d-4c0d-acf7-e21e165f184f service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:28.399394 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-bf721779-74ee-4a91-b1b7-21e740a095d1 req-e97b9fa6-0f8d-4c0d-acf7-e21e165f184f service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:28.410544 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-bf721779-74ee-4a91-b1b7-21e740a095d1 req-e97b9fa6-0f8d-4c0d-acf7-e21e165f184f service nova] Creating event network-changed:e52bac3a-78e8-4b6c-91a1-ce2a24838174 for instance b3aa2323-57ff-4019-8a14-9917310afeb0 on hv-cinder-81899 Apr 05 11:31:28.416139 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-bf721779-74ee-4a91-b1b7-21e740a095d1 req-e97b9fa6-0f8d-4c0d-acf7-e21e165f184f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287877 Apr 05 11:31:28.420552 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 764/1501] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:31:29.992718 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-49755978-2083-4357-a7c3-6500e27f43c9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:29.993315 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-49755978-2083-4357-a7c3-6500e27f43c9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:31:29.999593 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49755978-2083-4357-a7c3-6500e27f43c9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:30.000163 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49755978-2083-4357-a7c3-6500e27f43c9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:30.001663 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49755978-2083-4357-a7c3-6500e27f43c9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:30.002167 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49755978-2083-4357-a7c3-6500e27f43c9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:30.085310 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-49755978-2083-4357-a7c3-6500e27f43c9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lazy-loading 'services' on Instance uuid b3aa2323-57ff-4019-8a14-9917310afeb0 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 05 11:31:30.323011 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-49755978-2083-4357-a7c3-6500e27f43c9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/os-volume_attachments/8ba4b260-b835-4efa-8178-576690cae5be" status: 202 len: 0 microversion: 2.1 time: 0.334802 Apr 05 11:31:30.323600 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 738/1502] 10.222.0.39 () {58 vars in 1415 bytes} [Tue Apr 5 11:31:29 2022] DELETE /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/os-volume_attachments/8ba4b260-b835-4efa-8178-576690cae5be => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:31:30.332765 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ce9b1128-e21d-4eeb-b43c-a65df03cd66e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:30.334486 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ce9b1128-e21d-4eeb-b43c-a65df03cd66e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:31:30.341501 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ce9b1128-e21d-4eeb-b43c-a65df03cd66e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:30.342038 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ce9b1128-e21d-4eeb-b43c-a65df03cd66e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:30.342919 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ce9b1128-e21d-4eeb-b43c-a65df03cd66e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:30.343432 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ce9b1128-e21d-4eeb-b43c-a65df03cd66e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:30.373519 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ce9b1128-e21d-4eeb-b43c-a65df03cd66e tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045128 Apr 05 11:31:30.374247 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 765/1503] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:31:30 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:31:30.432373 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-0a8cb0c5-2c00-4ff9-bf54-ed7bd18eac29 req-d1f22131-621e-40db-a356-b2ec149b3fde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3aa2323-57ff-4019-8a14-9917310afeb0", "tag": "e52bac3a-78e8-4b6c-91a1-ce2a24838174"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:31:30.441903 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-0a8cb0c5-2c00-4ff9-bf54-ed7bd18eac29 req-d1f22131-621e-40db-a356-b2ec149b3fde service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:30.442374 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-0a8cb0c5-2c00-4ff9-bf54-ed7bd18eac29 req-d1f22131-621e-40db-a356-b2ec149b3fde service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:30.453270 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-0a8cb0c5-2c00-4ff9-bf54-ed7bd18eac29 req-d1f22131-621e-40db-a356-b2ec149b3fde service nova] Creating event network-changed:e52bac3a-78e8-4b6c-91a1-ce2a24838174 for instance b3aa2323-57ff-4019-8a14-9917310afeb0 on hv-cinder-81899 Apr 05 11:31:30.458056 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-0a8cb0c5-2c00-4ff9-bf54-ed7bd18eac29 req-d1f22131-621e-40db-a356-b2ec149b3fde service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029701 Apr 05 11:31:30.458684 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 739/1504] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:31:31.386473 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-807bd767-cfd4-4be6-8b9f-59c6a518e63b tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:31.387247 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-807bd767-cfd4-4be6-8b9f-59c6a518e63b tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:31:31.394234 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-807bd767-cfd4-4be6-8b9f-59c6a518e63b tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:31.394705 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-807bd767-cfd4-4be6-8b9f-59c6a518e63b tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:31.395460 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-807bd767-cfd4-4be6-8b9f-59c6a518e63b tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:31.395897 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-807bd767-cfd4-4be6-8b9f-59c6a518e63b tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:31.427304 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-807bd767-cfd4-4be6-8b9f-59c6a518e63b tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044912 Apr 05 11:31:31.427885 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 766/1505] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:31:31 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:31:32.440741 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5541e706-dfac-4ae6-9d5c-edd4daed41a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:32.441752 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5541e706-dfac-4ae6-9d5c-edd4daed41a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:31:32.448160 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5541e706-dfac-4ae6-9d5c-edd4daed41a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:32.448608 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5541e706-dfac-4ae6-9d5c-edd4daed41a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:32.449363 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5541e706-dfac-4ae6-9d5c-edd4daed41a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:32.449832 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5541e706-dfac-4ae6-9d5c-edd4daed41a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:32.478207 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5541e706-dfac-4ae6-9d5c-edd4daed41a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042490 Apr 05 11:31:32.478786 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 740/1506] 10.222.0.39 () {58 vars in 1301 bytes} [Tue Apr 5 11:31:32 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 11:31:32.492831 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dc1032e1-da57-4a71-942b-d4850b012086 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:32.493360 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dc1032e1-da57-4a71-942b-d4850b012086 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:31:32.499538 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc1032e1-da57-4a71-942b-d4850b012086 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:32.499983 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc1032e1-da57-4a71-942b-d4850b012086 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:32.500738 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc1032e1-da57-4a71-942b-d4850b012086 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:32.501169 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc1032e1-da57-4a71-942b-d4850b012086 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:32.572695 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-dc1032e1-da57-4a71-942b-d4850b012086 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] HTTP exception thrown: Instance b3aa2323-57ff-4019-8a14-9917310afeb0 is not attached to volume 8ba4b260-b835-4efa-8178-576690cae5be Apr 05 11:31:32.573350 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dc1032e1-da57-4a71-942b-d4850b012086 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Returning 404 to user: Instance b3aa2323-57ff-4019-8a14-9917310afeb0 is not attached to volume 8ba4b260-b835-4efa-8178-576690cae5be {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:31:32.574196 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dc1032e1-da57-4a71-942b-d4850b012086 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/os-volume_attachments/8ba4b260-b835-4efa-8178-576690cae5be" status: 404 len: 154 microversion: 2.1 time: 0.085388 Apr 05 11:31:32.574781 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 767/1507] 10.222.0.39 () {58 vars in 1415 bytes} [Tue Apr 5 11:31:32 2022] DELETE /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0/os-volume_attachments/8ba4b260-b835-4efa-8178-576690cae5be => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:31:33.834476 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b012a95e-572c-4a26-8b1e-2da71e0eb8a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:33.835035 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b012a95e-572c-4a26-8b1e-2da71e0eb8a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:31:33.841410 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b012a95e-572c-4a26-8b1e-2da71e0eb8a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:33.841864 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b012a95e-572c-4a26-8b1e-2da71e0eb8a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:33.842729 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b012a95e-572c-4a26-8b1e-2da71e0eb8a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:33.843228 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b012a95e-572c-4a26-8b1e-2da71e0eb8a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:33.867365 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b012a95e-572c-4a26-8b1e-2da71e0eb8a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 05 11:31:34.179989 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b012a95e-572c-4a26-8b1e-2da71e0eb8a8 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 204 len: 0 microversion: 2.1 time: 0.349032 Apr 05 11:31:34.180600 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 741/1508] 10.222.0.39 () {58 vars in 1238 bytes} [Tue Apr 5 11:31:33 2022] DELETE /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 11:31:34.189115 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-034f2346-a674-4343-9df7-d98210ab8c2d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:34.189730 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-034f2346-a674-4343-9df7-d98210ab8c2d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:31:34.196020 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-034f2346-a674-4343-9df7-d98210ab8c2d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:34.196466 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-034f2346-a674-4343-9df7-d98210ab8c2d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:34.197228 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-034f2346-a674-4343-9df7-d98210ab8c2d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:34.197659 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-034f2346-a674-4343-9df7-d98210ab8c2d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:34.332292 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-034f2346-a674-4343-9df7-d98210ab8c2d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:31:34.339653 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-034f2346-a674-4343-9df7-d98210ab8c2d tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1555 microversion: 2.1 time: 0.154857 Apr 05 11:31:34.340210 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 768/1509] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:31:34 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:31:35.357844 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-77ebe5db-b574-4bde-aefc-ebd34947e7f9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:35.358557 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-77ebe5db-b574-4bde-aefc-ebd34947e7f9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:31:35.365408 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-77ebe5db-b574-4bde-aefc-ebd34947e7f9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:35.365861 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-77ebe5db-b574-4bde-aefc-ebd34947e7f9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:35.366748 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-77ebe5db-b574-4bde-aefc-ebd34947e7f9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:35.367192 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-77ebe5db-b574-4bde-aefc-ebd34947e7f9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:35.497125 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-77ebe5db-b574-4bde-aefc-ebd34947e7f9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:31:35.505124 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-77ebe5db-b574-4bde-aefc-ebd34947e7f9 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1555 microversion: 2.1 time: 0.151576 Apr 05 11:31:35.505697 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 742/1510] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:31:35 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:31:36.522235 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0e2f6a33-64ce-46dc-a4bd-4b2b21d521cd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:36.522959 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0e2f6a33-64ce-46dc-a4bd-4b2b21d521cd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:31:36.529642 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0e2f6a33-64ce-46dc-a4bd-4b2b21d521cd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:36.541243 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0e2f6a33-64ce-46dc-a4bd-4b2b21d521cd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:36.541243 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0e2f6a33-64ce-46dc-a4bd-4b2b21d521cd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:36.541243 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0e2f6a33-64ce-46dc-a4bd-4b2b21d521cd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:36.559375 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-43dbb181-597a-4a33-bcf2-3e7700ca0ba9 req-92a3b01d-c232-4255-a96e-d0860b17f439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3aa2323-57ff-4019-8a14-9917310afeb0", "name": "network-vif-deleted", "tag": "e52bac3a-78e8-4b6c-91a1-ce2a24838174"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:31:36.568415 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-43dbb181-597a-4a33-bcf2-3e7700ca0ba9 req-92a3b01d-c232-4255-a96e-d0860b17f439 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:36.569778 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-43dbb181-597a-4a33-bcf2-3e7700ca0ba9 req-92a3b01d-c232-4255-a96e-d0860b17f439 service nova] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:36.580964 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-43dbb181-597a-4a33-bcf2-3e7700ca0ba9 req-92a3b01d-c232-4255-a96e-d0860b17f439 service nova] Creating event network-vif-deleted:e52bac3a-78e8-4b6c-91a1-ce2a24838174 for instance b3aa2323-57ff-4019-8a14-9917310afeb0 on hv-cinder-81899 Apr 05 11:31:36.585886 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-43dbb181-597a-4a33-bcf2-3e7700ca0ba9 req-92a3b01d-c232-4255-a96e-d0860b17f439 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030304 Apr 05 11:31:36.586663 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 743/1511] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Apr 5 11:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 11:31:36.592724 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0e2f6a33-64ce-46dc-a4bd-4b2b21d521cd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480e8207885a4342a1db97ca5a194b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '220a2c61da3646bc944112302aec29c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} Apr 05 11:31:36.601164 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0e2f6a33-64ce-46dc-a4bd-4b2b21d521cd tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 200 len: 1513 microversion: 2.1 time: 0.083056 Apr 05 11:31:36.610695 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 769/1512] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:31:36 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 1513 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:31:37.618715 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9dc7ed97-8314-4e1f-a570-2f57aa57c845 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:37.619407 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9dc7ed97-8314-4e1f-a570-2f57aa57c845 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [instance: b3aa2323-57ff-4019-8a14-9917310afeb0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 05 11:31:37.625474 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9dc7ed97-8314-4e1f-a570-2f57aa57c845 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:37.625917 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9dc7ed97-8314-4e1f-a570-2f57aa57c845 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:37.626712 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9dc7ed97-8314-4e1f-a570-2f57aa57c845 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 05 11:31:37.627146 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9dc7ed97-8314-4e1f-a570-2f57aa57c845 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Lock "6b35e173-6fb3-4cdd-bc5a-f4d1d668c5cc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 05 11:31:37.639645 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-9dc7ed97-8314-4e1f-a570-2f57aa57c845 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] HTTP exception thrown: Instance b3aa2323-57ff-4019-8a14-9917310afeb0 could not be found. Apr 05 11:31:37.640220 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9dc7ed97-8314-4e1f-a570-2f57aa57c845 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Returning 404 to user: Instance b3aa2323-57ff-4019-8a14-9917310afeb0 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 05 11:31:37.641550 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9dc7ed97-8314-4e1f-a570-2f57aa57c845 tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0" status: 404 len: 111 microversion: 2.1 time: 0.027566 Apr 05 11:31:37.642071 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 744/1513] 10.222.0.39 () {58 vars in 1235 bytes} [Tue Apr 5 11:31:37 2022] GET /compute/v2.1/servers/b3aa2323-57ff-4019-8a14-9917310afeb0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 11:31:37.650239 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c06575cc-93ac-4291-b7bc-ae98bc1b807c tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] Calling method '.version_select at 0x7fec0c323160>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 05 11:31:37.653527 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c06575cc-93ac-4291-b7bc-ae98bc1b807c tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [95dc93f7-255c-4ffe-8e5a-66addb753647] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 05 11:31:38.661823 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [None req-c06575cc-93ac-4291-b7bc-ae98bc1b807c tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] [95dc93f7-255c-4ffe-8e5a-66addb753647] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 57398. Apr 05 11:31:38.764047 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c06575cc-93ac-4291-b7bc-ae98bc1b807c tempest-TestMinimumBasicScenario-1980486733 tempest-TestMinimumBasicScenario-1980486733-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1906045848" status: 202 len: 0 microversion: 2.1 time: 1.117532 Apr 05 11:31:38.764631 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 770/1514] 10.222.0.39 () {58 vars in 1271 bytes} [Tue Apr 5 11:31:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1906045848 => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 11:33:27.054134 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:33:27.054868 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: Tue Apr 5 11:33:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:33:45.468242 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:33:45.468845 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: Tue Apr 5 11:33:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:33:49.650872 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:33:49.651566 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: Tue Apr 5 11:33:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:34:07.184257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:34:07.184257 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: Tue Apr 5 11:34:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:35:13.863034 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:35:13.863728 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: Tue Apr 5 11:35:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:36:46.004885 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:36:46.005546 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: Tue Apr 5 11:36:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:36:47.062362 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:36:47.063074 dv-cinder-818994-3-iscsi devstack@n-api.service[117593]: Tue Apr 5 11:36:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:37:05.476740 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:37:05.477458 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: Tue Apr 5 11:37:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 11:37:09.661961 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 11:37:09.663184 dv-cinder-818994-3-iscsi devstack@n-api.service[117594]: Tue Apr 5 11:37:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!